-- Logs begin at Thu 2022-05-26 20:09:33 UTC, end at Thu 2022-05-26 21:53:38 UTC. -- May 26 21:17:25.686063 dv-cinder-828805-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 21:17:25.695047 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 21:17:25 2022] *** May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: nodename: dv-cinder-828805-3-iscsi May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: machine: x86_64 May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: clock source: unix May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: pcre jit disabled May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: detected number of CPU cores: 4 May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: current working directory: / May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: detected binary path: /usr/bin/uwsgi-core May 26 21:17:25.697069 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: your processes number limit is 47680 May 26 21:17:25.697790 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: your memory page size is 4096 bytes May 26 21:17:25.697790 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: detected max file descriptor number: 2048 May 26 21:17:25.697790 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: lock engine: pthread robust mutexes May 26 21:17:25.697790 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: thunder lock: enabled May 26 21:17:25.697790 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 21:17:25.697790 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 21:17:25.742227 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: Python main interpreter initialized at 0x565261c619c0 May 26 21:17:25.742227 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: python threads support enabled May 26 21:17:25.742227 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: your server socket listen backlog is limited to 100 connections May 26 21:17:25.742227 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: your mercy for graceful operations on workers is 90 seconds May 26 21:17:25.742632 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: mapped 403077 bytes (393 KB) for 2 cores May 26 21:17:25.742632 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: *** Operational MODE: preforking *** May 26 21:17:25.742928 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: *** uWSGI is running in multiple interpreter mode *** May 26 21:17:25.742928 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: spawned uWSGI master process (pid: 103900) May 26 21:17:25.743129 dv-cinder-828805-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 21:17:25.743768 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: spawned uWSGI worker 1 (pid: 103901, cores: 1) May 26 21:17:25.744104 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: spawned uWSGI worker 2 (pid: 103902, cores: 1) May 26 21:17:25.744260 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 21:17:26.910171 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:17:26.910808 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:17:27.633639 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:17:27.633639 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: from cryptography.utils import int_from_bytes May 26 21:17:27.633950 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:17:27.633950 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: from cryptography.utils import int_from_bytes May 26 21:17:27.635642 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:17:27.635642 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: from cryptography.utils import int_from_bytes May 26 21:17:27.636000 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:17:27.636000 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: from cryptography.utils import int_from_bytes May 26 21:17:30.229773 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:17:30.230560 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:17:30.230560 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:17:30.230902 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:17:30.231153 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:17:30.231539 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.231906 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.232238 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.232549 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.232884 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.233193 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.233509 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.233826 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.234150 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.234408 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.234723 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.235048 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-3-iscsi {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.235364 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.235668 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.236006 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.236324 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.236627 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.236948 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.237251 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.237746 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.238064 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:17:30.238455 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.238611 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:17:30.238692 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.238760 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.238831 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:17:30.239104 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.239204 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:17:30.239422 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.239536 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:17:30.239777 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.239894 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.240075 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.240196 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.240388 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.240504 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.240760 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.241385 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.241589 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.241695 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.241879 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.241972 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-3-iscsi {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.242195 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.242288 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.242508 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.242619 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.242832 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.242939 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.243099 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.243331 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.243450 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.243594 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.243701 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-3-iscsi {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.243941 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244048 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244263 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244351 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244585 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244681 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244895 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.244995 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.245210 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.245296 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.245528 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.245627 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.245824 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.245931 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.246148 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.246318 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.246465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.246622 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.246763 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.246922 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.247056 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.247228 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.247366 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.247556 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.247689 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.247891 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248191 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248389 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248567 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248699 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248828 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.248951 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249098 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249239 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249400 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249536 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249682 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249806 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-3-iscsi {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.249935 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.250089 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.250227 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.250398 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.250540 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.250706 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.250858 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.251089 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.251224 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.251393 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.251524 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.251698 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.251860 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252029 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252165 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252333 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252468 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252638 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252765 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.252940 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.253067 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.253258 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.253392 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.253569 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.253703 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.253883 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254011 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254182 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254485 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254611 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254789 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.254930 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.255100 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.255236 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.255399 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.255533 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.255698 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.255877 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256003 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256126 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256247 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256369 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256594 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256725 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.256913 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257020 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257227 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257317 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257475 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257569 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257723 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.257867 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258036 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258192 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258350 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258514 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258652 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258820 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.258954 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.259073 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.259254 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.259373 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.259553 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.259677 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.259876 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260021 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260225 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260310 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260537 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260631 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260840 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.260939 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.261154 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.261249 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.261462 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.261547 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.261776 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.261869 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262078 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262168 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262379 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262469 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262681 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262775 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.262985 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.263070 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.263282 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.263373 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.263590 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.263691 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.263928 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264016 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264233 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264326 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264549 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264645 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264852 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.264936 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.265155 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.265239 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.265456 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.265546 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.265754 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.265839 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266067 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266211 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266369 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266456 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266672 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266768 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.266919 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267002 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267219 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267308 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267518 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267610 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267853 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.267943 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.268157 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.268244 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.268459 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.268551 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.268761 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.268846 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269057 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269148 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269359 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269444 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269659 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269751 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.269958 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270042 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270260 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270343 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270558 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270655 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270858 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.270954 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.271157 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.271254 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.271457 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.271553 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.271768 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.271854 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.272267 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.272362 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.272443 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.272540 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.272685 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.272805 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273003 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273088 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273312 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273398 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273616 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273757 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.273922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.274008 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.274238 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.274332 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.274549 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.274634 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.274864 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.274948 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.275166 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.275251 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.275466 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.275551 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.275796 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.275886 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.276100 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.276195 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.276400 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.276486 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.276711 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.276796 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.277007 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.277112 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.277308 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.277400 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.277619 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.277704 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.277918 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.278003 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.278218 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.278302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.278516 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.278613 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.278815 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.278907 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.279113 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.279205 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.279411 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.279504 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.279707 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.279824 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.280026 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.280111 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.280320 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.280418 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.280633 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.280726 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.280948 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.281040 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.281249 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.281343 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.281549 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.281637 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.281850 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.281935 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.282161 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:17:30.282247 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.282491 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.282577 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.282823 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.282928 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.283158 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.283253 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.283468 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.283560 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.283794 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.283898 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.284107 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.284204 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.284428 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.284520 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.284732 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.284826 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285042 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285137 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285355 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285439 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285658 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285743 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.285965 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286051 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286268 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286353 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286574 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286661 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286882 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.286975 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.287200 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.287291 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.287510 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.288128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.288368 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.288453 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.288682 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.288766 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.288992 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.289087 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.289298 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.289390 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.289608 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.289693 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.289916 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290013 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290220 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290306 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290522 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290607 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290825 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.290922 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.291131 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.291224 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.291432 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.291554 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.291763 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.291862 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.292099 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.292184 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.292404 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.292495 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.292710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.292802 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293023 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293115 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293331 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293426 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293637 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293729 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.293945 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294030 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294247 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294333 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294552 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294636 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294857 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.294949 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.295159 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.295258 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.295464 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.295548 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.295793 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.295951 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.296101 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.296200 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.296416 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.296501 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.296716 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.296808 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297019 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297121 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297323 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297416 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297629 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297715 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.297933 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298035 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298230 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298314 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298528 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298613 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298828 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.298913 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.299133 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.299218 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.299433 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.299525 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.299759 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.299847 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.300091 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.300177 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.300392 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.300476 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.300712 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.300797 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301010 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301094 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301317 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301405 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301621 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301712 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.301923 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302007 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302221 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302315 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302520 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302603 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302823 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.302907 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.303120 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.303240 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304012 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304113 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304318 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304403 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304617 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304716 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.304917 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305001 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305218 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305302 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305516 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305609 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305826 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.305911 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.306125 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.306217 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.306426 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.306512 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.306727 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.306811 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307032 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307115 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307349 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307435 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307657 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307809 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.307991 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.308077 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.308321 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.308416 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.308646 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.308732 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.308947 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309041 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309260 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309344 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309572 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309664 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309881 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.309978 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.310182 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.310268 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.310490 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.310573 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.310787 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.310881 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.311088 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.311181 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.311387 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.311480 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.311691 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.311809 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.312013 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.312110 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.312315 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.312407 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.312615 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.312713 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.313167 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.313267 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.313470 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.313556 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.313789 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.313886 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314091 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314392 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314477 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314692 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314780 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.314993 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.315085 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.315324 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.315409 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.315627 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.315723 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.315961 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316057 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316273 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316357 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316583 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316668 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316899 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.316984 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.317209 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.317301 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.317523 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.317615 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.317830 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.317922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.318138 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.318253 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.318442 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.318527 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.318751 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.318831 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.319090 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.319183 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.319398 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.319484 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.319713 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.319864 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320046 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320145 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320356 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320441 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320662 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320747 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.320978 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321071 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321278 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321375 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321584 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321668 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321893 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.321987 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.322195 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.322288 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.322498 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.322590 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.322806 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.322900 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.323117 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.323202 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.323425 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.323509 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.323730 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.323880 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324055 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324152 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324361 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324445 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324664 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324757 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.324965 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325050 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325266 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325357 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325572 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325658 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325877 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.325962 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.326183 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.326275 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.326489 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.326574 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.326803 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.326932 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.327103 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.327237 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.327403 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.327488 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.327721 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.327882 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328051 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328150 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328353 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328445 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328659 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328743 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.328960 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329054 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329298 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329383 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329605 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329689 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329906 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.329992 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.330205 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.330293 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.330507 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.330593 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.330813 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.330907 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.331122 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.331207 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.331426 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.331518 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.331730 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.331869 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332052 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332145 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332360 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332453 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332665 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332750 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.332960 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333045 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333262 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333357 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333566 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333658 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333872 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.333957 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.334176 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.334268 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.334506 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.334591 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.334812 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.334896 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.335112 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.335204 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.335412 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.335496 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.335717 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.335867 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.336046 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.336144 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.336348 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.336619 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.336711 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.336937 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337034 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337247 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337374 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337565 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337650 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337865 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.337964 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.338176 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.338261 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.338493 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.338578 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.338798 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.338893 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.339106 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.339191 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.339411 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.339510 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.339714 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.339829 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340042 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340128 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340345 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340429 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340647 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340741 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.340935 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341029 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341235 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341321 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341537 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341630 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341838 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.341923 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.342138 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.342223 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.342439 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.342533 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.342743 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.342828 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343042 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343125 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343344 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343448 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343642 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343727 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.343975 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.344061 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.344276 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.344543 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.344630 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.344878 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.344965 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.345178 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.345262 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.345480 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.345567 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.345779 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.345864 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.346112 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.346209 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.346416 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.346509 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.346751 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.346836 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.347078 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.347172 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.347380 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.347473 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.347687 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.347828 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348014 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348101 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348317 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348404 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348624 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348710 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.348927 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349012 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349225 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349318 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349527 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349619 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349831 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.349916 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.350661 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.350767 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.350957 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351043 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351258 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351353 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351558 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351643 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351888 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.351978 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.352191 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.352297 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.352495 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.352580 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.352795 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.352878 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.353109 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.353208 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.353414 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.353506 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.353713 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.353798 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354012 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354106 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354310 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354395 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354614 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354698 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.354915 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355001 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355223 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355308 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355523 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355608 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355860 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.355950 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.356164 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.356250 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.356466 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.356562 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.356767 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.356853 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357073 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357162 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357376 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357461 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357675 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357763 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.357980 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358075 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358286 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358380 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358584 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358668 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358885 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.358978 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.359188 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.359286 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.359487 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.359580 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.359810 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.359910 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.360111 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.360208 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.360416 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.360502 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.360715 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.360799 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361014 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361110 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361317 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361409 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361616 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361703 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.361915 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362007 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362218 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362305 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362518 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362609 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362815 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.362901 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.363111 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.363204 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.363406 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.363555 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.363704 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.363814 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364026 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364112 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364322 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364406 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364621 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364709 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.364921 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.365006 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.365222 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.365320 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.365519 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.365617 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.366374 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.366469 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.366684 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.366778 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.366985 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.367070 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.367285 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.367369 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.367590 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.367826 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.367920 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368007 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368201 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368288 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368505 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368600 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368825 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.368910 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.369131 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.369223 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.369428 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.369513 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.369732 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.369817 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370029 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370114 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370326 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370412 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370624 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370708 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.370926 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371012 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371223 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371519 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371605 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371841 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.371932 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.372141 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.372228 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.372438 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.372523 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.372751 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.372845 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373053 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373140 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373351 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373436 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373649 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373747 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.373952 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374037 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374258 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374343 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374564 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374658 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374872 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.374958 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.375181 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.375266 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.375488 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.375583 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.375818 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.375905 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.376123 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.376207 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.376427 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.376524 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.376732 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.376817 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377031 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377116 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377338 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377467 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377641 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377727 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.377941 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378025 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378238 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378323 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378536 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378621 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378840 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.378924 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.379142 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.379235 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.379447 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.379563 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.379781 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.379896 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.380102 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.380196 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.380421 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.380507 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.380719 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.380818 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381022 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381108 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381344 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381440 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381652 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381745 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.381957 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.382043 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.382260 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.382449 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.382564 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.382759 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.382868 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.383066 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.383158 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.383375 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.383460 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.383676 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.383778 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384005 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384101 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384310 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384403 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384631 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384717 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.384933 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385017 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385232 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385325 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385532 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385624 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385831 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.385915 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.386135 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.386228 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.386434 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.386519 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.386739 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.386848 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.387039 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.387157 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.387457 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.387542 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.387781 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.387920 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.388091 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.388178 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.388391 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.388477 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.388695 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.388780 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389107 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389307 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389430 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389616 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389734 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.389913 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.390046 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.390323 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.390409 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.390634 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.390719 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.390941 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391037 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391248 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391342 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391547 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391642 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391872 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.391960 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.392177 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.392264 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.392495 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.392631 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.392802 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.392918 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.393100 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.393197 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.393399 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.393561 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.393714 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.393882 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.394018 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.394189 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.394331 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.394507 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.394743 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.394842 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.395053 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.395140 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.395356 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.395451 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.395697 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.395844 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.396024 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.396111 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.396326 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.396420 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.396648 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.396734 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.397480 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.397583 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.397793 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.397878 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.398102 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.398192 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.398423 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.398509 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.398708 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.398805 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399010 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399095 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399327 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399412 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399632 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399717 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.399964 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400066 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400264 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400350 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400580 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400675 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400896 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.400981 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.401199 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.401321 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.401511 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.401609 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.401814 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.401907 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.402115 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.402223 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.402416 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.402511 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.402715 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.402829 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.403051 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.403143 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.403354 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.403450 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.403671 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.403798 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404028 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404129 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404332 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404426 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404631 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404717 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.404947 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405040 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405247 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405335 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405552 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405639 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405858 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.405943 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.406162 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.406248 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.406460 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.406546 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.406758 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.406843 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407066 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407154 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407362 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407455 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407662 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407815 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.407989 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408119 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408295 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408381 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408594 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408694 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408894 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.408980 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.409193 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.409279 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.409498 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.409592 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.409798 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.409885 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410098 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410191 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410395 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410494 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410694 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410779 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.410996 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.411082 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.411295 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.411382 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.411620 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.411706 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.411946 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.412033 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.412256 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.412350 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.412634 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.413214 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.413452 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.413539 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.413798 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.413886 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.414106 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.414191 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.414429 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.414516 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.414727 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.414815 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.415026 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.415113 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.415399 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.415500 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.415736 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.415936 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.416238 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.416326 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.416546 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.416641 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.416853 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.416940 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.417155 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.417241 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.417457 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.417551 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.417758 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.417883 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.418076 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.418198 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.418375 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.418633 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.418720 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.418962 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419058 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419366 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419572 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419658 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419892 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.419993 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.420214 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.420309 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.420517 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.420603 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.420826 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.420911 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.421138 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.421234 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.421450 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.421536 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.421795 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.421892 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.422132 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.422221 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.422453 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.422541 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.422764 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.422851 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.423072 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.423159 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.423437 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.423592 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.423954 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.424054 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.424290 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.424377 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.424608 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.424694 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.424921 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425006 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425230 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425363 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425543 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425631 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425857 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.425956 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.426169 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.426261 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.426482 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.426696 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.426782 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427020 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427114 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427330 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427416 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427642 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427737 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.427997 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.428087 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.428335 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.428427 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.428649 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.428746 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.428960 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.429046 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.429306 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.429424 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.429648 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.429744 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.429960 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.430047 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.430279 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.430365 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.430649 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.430736 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.431046 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.431177 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.431508 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.431678 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.431838 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.432021 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.432152 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.432381 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.432485 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.432708 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.432804 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433031 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433125 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433348 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433472 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433664 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433752 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.433990 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434076 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434294 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434389 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434598 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434692 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434904 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.434989 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.435213 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.435299 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.435523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.435610 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.435855 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.435946 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.436166 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.436270 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.436500 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.436591 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.436846 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.436931 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.437157 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.437251 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.437479 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.437708 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.438116 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.438333 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.438589 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.438849 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.438936 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.439183 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.439269 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.439511 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.439596 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.439858 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.440079 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.440165 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.440392 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.440478 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.440721 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.440809 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441043 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441143 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441359 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441444 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441669 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441763 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.441972 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442058 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442276 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442362 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442582 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442668 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442884 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.442971 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.443183 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.443275 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.443488 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.443628 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.443829 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.443936 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.444152 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.444252 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.444454 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.444540 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.444755 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.444840 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445056 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445151 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445363 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445448 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445665 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445895 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.445981 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.446244 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.446339 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.446547 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.446679 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.446857 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.446952 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.447158 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.447253 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.447467 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.447553 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.447795 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.447896 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.448110 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.448195 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.448415 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.448547 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.448719 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.448857 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449031 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449119 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449338 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449424 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449641 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449736 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.449941 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450247 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450333 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450552 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450646 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450852 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.450938 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.451156 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.451243 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.451456 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.451543 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.451796 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.451900 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.452100 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.452187 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.452404 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.452648 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.452743 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.452983 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453070 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453288 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453382 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453589 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453675 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453890 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.453976 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.454190 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.454285 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.454504 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.454591 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.454805 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.454891 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.455110 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.455198 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.455410 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.455503 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.455717 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.455860 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.456107 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.456194 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.456412 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.456498 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.456721 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.456812 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457031 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457118 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457345 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457460 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457648 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457754 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.457951 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458037 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458255 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458339 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458559 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458653 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458867 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.458954 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.459172 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.459256 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460021 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460132 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460359 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460444 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460673 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460888 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.460982 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.461220 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.461307 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.461538 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.461623 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.461866 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.461965 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.462176 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.462270 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.462483 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.462576 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.462783 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.462877 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.463087 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.463174 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.463408 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.463514 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.463718 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.463889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464144 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464359 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464469 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464667 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464780 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.464978 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.465098 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.465285 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.465416 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.465593 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.465725 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.465899 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466045 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466203 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466364 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466506 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466672 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466810 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.466993 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.467115 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.467299 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.467420 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.467626 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.467733 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.467990 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.468077 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.468320 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.468408 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.468644 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.468733 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.468947 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469033 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469251 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469338 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469553 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469638 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469860 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.469954 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.470164 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.470258 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.470469 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.470556 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.470768 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.470863 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.471070 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.471156 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.471378 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.471463 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.471675 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.471788 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472004 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472123 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472306 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472434 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472607 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472752 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.472913 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.473070 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.473212 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.473379 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.473514 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.473696 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.473814 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474015 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474102 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474324 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474419 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474642 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474737 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.474956 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.475070 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.475845 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.475973 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.476186 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.476289 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.476488 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.476575 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.476791 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.476886 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.477092 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.477181 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.477414 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.477499 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.477717 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.477803 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478024 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478118 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478338 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478424 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478644 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478729 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.478941 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.479029 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.479241 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.479334 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.479544 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.479639 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.479915 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480028 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480170 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480271 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480468 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480555 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480766 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.480859 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481071 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481166 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481369 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481456 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481668 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481754 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.481965 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482126 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482264 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482349 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482561 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482647 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482860 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.482960 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.483163 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.483250 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.483462 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.483557 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.483773 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.483863 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484074 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484160 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484373 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484458 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484669 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484756 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.484997 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.485083 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.485326 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.485421 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.485634 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.485721 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.485950 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486063 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486252 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486359 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486557 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486641 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486858 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.486943 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.487168 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.487265 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.487482 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.487569 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.487811 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.487911 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.488118 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.488213 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.488440 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.488533 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.488744 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.488836 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489050 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489154 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489354 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489440 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489662 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489755 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.489969 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.490063 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.490274 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.490360 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.490595 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.490700 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.491439 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.491535 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.491837 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.491928 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.492023 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:17:30.492103 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.492383 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.492697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.493010 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.493316 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.493639 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.493943 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.494247 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.494556 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.494865 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.495169 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.495479 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.495809 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.496134 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.496453 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.496759 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.497079 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.497400 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.497744 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.498050 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.498385 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.498707 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.499019 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.499324 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.499623 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:17:30.499884 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:17:30.550743 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Registered counter for database nova_api May 26 21:17:30.558674 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Registered counter for database nova_api May 26 21:17:30.572738 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.579015 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.579530 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.585651 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.638164 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.context [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32e2bb36-b7b6-4358-a218-787992281ee0(cell1) {{(pid=103902) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:17:30.642304 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:17:30.642472 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.context [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32e2bb36-b7b6-4358-a218-787992281ee0(cell1) {{(pid=103901) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:17:30.643908 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:17:30.644716 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:17:30.646527 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:17:30.646669 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:17:30.648189 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:17:30.648711 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Registered counter for database nova_cell0 May 26 21:17:30.648974 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:17:30.651036 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:17:30.652727 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Registered counter for database nova_cell1 May 26 21:17:30.653041 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Registered counter for database nova_cell0 May 26 21:17:30.657072 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Registered counter for database nova_cell1 May 26 21:17:30.660687 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.662492 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.664726 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.665991 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.668973 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.671502 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.672286 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.674259 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.819511 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Registered counter for database nova_cell0 May 26 21:17:30.819736 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Registered counter for database nova_cell0 May 26 21:17:30.828264 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.831715 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:17:30.832812 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:30.836236 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:17:31.291352 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:17:31.298554 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:17:31.438331 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:17:31.446112 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:17:31.638235 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:17:31.644176 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:17:31.649474 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565261c619c0 pid: 103901 (default app) May 26 21:17:31.651534 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:17:31.652747 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001798 May 26 21:17:31.653164 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu May 26 21:17:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:17:31.784310 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:17:31.790814 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-bc3f19b3-363a-457e-b1fa-6847411a7038 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:17:31.796255 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565261c619c0 pid: 103902 (default app) May 26 21:18:52.277084 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:52.278709 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 May 26 21:18:52.280626 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:18:52.292012 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_api:SELECT=3 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:52.294612 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_cell1:SELECT=3 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:52.294612 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_cell0:SELECT=3 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:52.295605 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:52.758444 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-6878e919-7391-4261-8884-c7f404269722 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:52.790332 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-6878e919-7391-4261-8884-c7f404269722 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.503476 May 26 21:18:52.791166 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 26 21:18:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:18:55.080434 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:55.083231 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-a8e3c9e5-27c6-433e-88d7-191e9bf460d1 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003259 May 26 21:18:55.084153 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:18:55.155815 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-ba31e038-ba7a-46ae-9a50-376d5eec33e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:18:55.176674 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:18:55.176674 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: warnings.warn(msg) May 26 21:18:55.280223 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-ba31e038-ba7a-46ae-9a50-376d5eec33e5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.188880 May 26 21:18:55.281024 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:18:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:18:55.497906 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0d7e0887-e9e7-4ef1-80ed-45a42d87b055 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:18:55.500377 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:18:55.500377 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: warnings.warn(msg) May 26 21:18:55.503076 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=3 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:55.503914 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell0:SELECT=3 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:55.504803 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell1:SELECT=3 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:55.505492 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:55.651431 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0d7e0887-e9e7-4ef1-80ed-45a42d87b055 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361910 May 26 21:18:55.652301 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 26 21:18:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:18:57.972210 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-ba31e038-ba7a-46ae-9a50-376d5eec33e5 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:57.973369 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-ba31e038-ba7a-46ae-9a50-376d5eec33e5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 May 26 21:18:57.973861 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:18:58.085102 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-6990e7b1-3d9c-44c1-b87f-0de0e10641a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "ram": 512, "swap": 0}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:18:58.103575 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:18:58.103575 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: warnings.warn(msg) May 26 21:18:58.177537 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-6990e7b1-3d9c-44c1-b87f-0de0e10641a9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.197684 May 26 21:18:58.181428 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:18:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:18:58.191378 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-99e21ecc-fa05-492f-8617-a8884d5dae81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:18:58.193009 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:18:58.193009 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: warnings.warn(msg) May 26 21:18:58.288381 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-99e21ecc-fa05-492f-8617-a8884d5dae81 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100678 May 26 21:18:58.289169 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 26 21:18:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:00.530083 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-6990e7b1-3d9c-44c1-b87f-0de0e10641a9 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:00.531099 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-6990e7b1-3d9c-44c1-b87f-0de0e10641a9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 26 21:19:00.531506 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:00.598461 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-344ddfb7-a960-444a-ac74-7da76ce5d22b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:00.688040 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-344ddfb7-a960-444a-ac74-7da76ce5d22b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149585 May 26 21:19:00.688766 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:19:00.703369 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-f13ae384-8046-4326-95cd-5d81934a4012 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:00.795177 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-f13ae384-8046-4326-95cd-5d81934a4012 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098207 May 26 21:19:00.796141 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 26 21:19:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:03.075382 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-344ddfb7-a960-444a-ac74-7da76ce5d22b admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:03.076484 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-344ddfb7-a960-444a-ac74-7da76ce5d22b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 26 21:19:03.077649 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:03.138981 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-4c33dcdc-c66c-49a8-b051-fa2ca5499e83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:03.219677 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-4c33dcdc-c66c-49a8-b051-fa2ca5499e83 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136052 May 26 21:19:03.220392 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:03.232588 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-6f0ebce5-f43d-41a4-8b4d-4c15b46da7cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:03.320719 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-6f0ebce5-f43d-41a4-8b4d-4c15b46da7cb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091906 May 26 21:19:03.321310 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 26 21:19:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:05.595100 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-4c33dcdc-c66c-49a8-b051-fa2ca5499e83 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:05.596156 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-4c33dcdc-c66c-49a8-b051-fa2ca5499e83 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 26 21:19:05.596552 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:19:05.661672 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0abab71a-be1e-43b1-a11c-11d383d3c74b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:05.746051 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0abab71a-be1e-43b1-a11c-11d383d3c74b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143018 May 26 21:19:05.747783 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:19:05.759156 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-ef8cd608-08b7-49f8-affb-cbfa2d9ad0a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:05.886163 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-ef8cd608-08b7-49f8-affb-cbfa2d9ad0a7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130514 May 26 21:19:05.886835 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 26 21:19:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:08.203860 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0abab71a-be1e-43b1-a11c-11d383d3c74b admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:08.205424 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0abab71a-be1e-43b1-a11c-11d383d3c74b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 May 26 21:19:08.206104 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:08.275101 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-fb09c6ba-969b-4e04-b963-3b3877aab53b admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:08.303327 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-fb09c6ba-969b-4e04-b963-3b3877aab53b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090209 May 26 21:19:08.304252 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 26 21:19:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:10.763507 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0abab71a-be1e-43b1-a11c-11d383d3c74b admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:10.764866 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0abab71a-be1e-43b1-a11c-11d383d3c74b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001944 May 26 21:19:10.765444 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:10.838513 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-7d0b90a5-181e-497a-9411-1edf9483da0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:10.911103 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-7d0b90a5-181e-497a-9411-1edf9483da0c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.137343 May 26 21:19:10.911658 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:10.925217 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-087b8bb6-6bf6-4fb7-a641-8990bfd0dffd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:11.016892 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-087b8bb6-6bf6-4fb7-a641-8990bfd0dffd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096188 May 26 21:19:11.017440 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 26 21:19:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:13.274979 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-7d0b90a5-181e-497a-9411-1edf9483da0c admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:13.276197 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-7d0b90a5-181e-497a-9411-1edf9483da0c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 May 26 21:19:13.276611 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:19:13.348913 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-a7d133bb-b716-4fd3-a398-a22a0669131a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:13.425677 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-a7d133bb-b716-4fd3-a398-a22a0669131a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.143006 May 26 21:19:13.426271 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:19:13.446364 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-3d1c94a2-735b-4ad9-9a21-481dafe17370 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:13.542037 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-3d1c94a2-735b-4ad9-9a21-481dafe17370 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099944 May 26 21:19:13.542786 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 26 21:19:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:19:15.800196 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-a7d133bb-b716-4fd3-a398-a22a0669131a admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:15.801436 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-a7d133bb-b716-4fd3-a398-a22a0669131a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 May 26 21:19:15.801917 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:15.861749 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-f86b7c24-cace-422e-ae55-058c80dd3312 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:15.946063 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-f86b7c24-cace-422e-ae55-058c80dd3312 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.137959 May 26 21:19:15.946680 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:15.958520 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-763f0b9e-ffd1-4fb5-a694-6ffa8fc65c75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:16.098076 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-763f0b9e-ffd1-4fb5-a694-6ffa8fc65c75 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143321 May 26 21:19:16.098681 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 26 21:19:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:18.351237 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-f86b7c24-cace-422e-ae55-058c80dd3312 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:18.352350 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-f86b7c24-cace-422e-ae55-058c80dd3312 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 26 21:19:18.352753 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:18.410311 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0327db07-11f3-4ef0-98cd-63a1faf7a348 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "vcpus": 4}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:18.483301 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0327db07-11f3-4ef0-98cd-63a1faf7a348 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123956 May 26 21:19:18.483511 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:18.495441 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-64a441b2-b4dd-4db2-8115-ca8583fdc82c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:18.594907 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-64a441b2-b4dd-4db2-8115-ca8583fdc82c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103021 May 26 21:19:18.595459 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 26 21:19:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:20.876399 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0327db07-11f3-4ef0-98cd-63a1faf7a348 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:20.877435 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0327db07-11f3-4ef0-98cd-63a1faf7a348 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 26 21:19:20.877842 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:20.952097 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0ffc4a93-d116-4279-918f-ba19ad97e373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:21.222368 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0ffc4a93-d116-4279-918f-ba19ad97e373 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.338023 May 26 21:19:21.223122 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 26 21:19:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:21.235412 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-500875d3-460d-49b9-9354-5df8c37a5a54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:21.327581 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-500875d3-460d-49b9-9354-5df8c37a5a54 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095885 May 26 21:19:21.328322 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 26 21:19:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:19:45.494335 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0ffc4a93-d116-4279-918f-ba19ad97e373 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:45.495345 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0ffc4a93-d116-4279-918f-ba19ad97e373 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 26 21:19:45.495834 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:45.506895 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:45.554945 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-8f384cc0-29a4-4ad3-8a54-696dfb39ed9e admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:45.573282 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-8f384cc0-29a4-4ad3-8a54-696dfb39ed9e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071537 May 26 21:19:45.573823 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 26 21:19:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:46.552858 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0ffc4a93-d116-4279-918f-ba19ad97e373 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:46.553860 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0ffc4a93-d116-4279-918f-ba19ad97e373 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 26 21:19:46.554259 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:46.765904 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-d4b77dc0-6955-4837-aa85-c27bfa4eefa7 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:46.771909 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.wsgi [None req-d4b77dc0-6955-4837-aa85-c27bfa4eefa7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-d4b77dc0-6955-4837-aa85-c27bfa4eefa7 admin admin] Request method failure captured: May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Accept: application/json May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Accept-Encoding: gzip, deflate May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Connection: keep-alive May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Content-Length: 0 May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Host: 10.222.0.42 May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Openstack-Api-Version: compute 2.90 May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Openstack-System-Scope: None May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: User-Agent: python-novaclient May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Auth-Token: gAAAAABij-7yH7ZZrz1-u1FZlPTaNOHZgW9PoCpmP0winCJgBTVlLqjAn2VoBCGwA9xZoP2EWt_mCrTMAkHwXmq5L0hIUSi9g6FiGs4xbtf3viGmpUP_2sQNhD10urlqqM9mgZ-_BdTCRIklPtRNJZgEe4D51bkkYZ7LlSwa6EiD0g7P4O7dKDI May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Domain-Id: None May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Domain-Name: None May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Identity-Status: Confirmed May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Is-Admin-Project: True May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Domain-Id: default May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Domain-Name: Default May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Name: admin May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Role: admin,member,reader May 26 21:19:46.775142 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Roles: admin,member,reader May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}] May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant: admin May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant-Name: admin May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User: admin May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Domain-Id: default May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Domain-Name: Default May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Id: ef098ca75a4b4231b612fc38df12339d May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Name: admin May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: method: > May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: exception: Flavor 42 could not be found. May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: action_args: {'id': '42'} May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:19:46.776889 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:46.777922 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:46.779302 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-d4b77dc0-6955-4837-aa85-c27bfa4eefa7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:19:46.782025 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-d4b77dc0-6955-4837-aa85-c27bfa4eefa7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062842 May 26 21:19:46.782025 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu May 26 21:19:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:19:46.786467 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0225f60a-9af4-4271-ab80-9ee152b3a44e admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:46.789928 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:46.808909 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0225f60a-9af4-4271-ab80-9ee152b3a44e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025923 May 26 21:19:46.809451 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu May 26 21:19:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:19:46.822676 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0cebe08f-1dfb-4422-a8b8-e38da02c7c17 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:46.844253 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0cebe08f-1dfb-4422-a8b8-e38da02c7c17 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025077 May 26 21:19:46.844828 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu May 26 21:19:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:46.854934 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-81076c39-5622-4ed5-bffc-e27aeef53bcf admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:46.860886 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.wsgi [None req-81076c39-5622-4ed5-bffc-e27aeef53bcf admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-81076c39-5622-4ed5-bffc-e27aeef53bcf admin admin] Request method failure captured: May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Accept: application/json May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Accept-Encoding: gzip, deflate May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Connection: keep-alive May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Content-Length: 0 May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Host: 10.222.0.42 May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Openstack-Api-Version: compute 2.90 May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Openstack-System-Scope: None May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: User-Agent: python-novaclient May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Auth-Token: gAAAAABij-7yH7ZZrz1-u1FZlPTaNOHZgW9PoCpmP0winCJgBTVlLqjAn2VoBCGwA9xZoP2EWt_mCrTMAkHwXmq5L0hIUSi9g6FiGs4xbtf3viGmpUP_2sQNhD10urlqqM9mgZ-_BdTCRIklPtRNJZgEe4D51bkkYZ7LlSwa6EiD0g7P4O7dKDI May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Domain-Id: None May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Domain-Name: None May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Identity-Status: Confirmed May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Is-Admin-Project: True May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Domain-Id: default May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Domain-Name: Default May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Name: admin May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Role: admin,member,reader May 26 21:19:46.864271 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Roles: admin,member,reader May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}] May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant: admin May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant-Name: admin May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User: admin May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Domain-Id: default May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Domain-Name: Default May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Id: ef098ca75a4b4231b612fc38df12339d May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Name: admin May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: method: > May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: exception: Flavor 42 could not be found. May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: action_args: {'id': '42'} May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:19:46.873697 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:46.874710 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:46.876049 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-81076c39-5622-4ed5-bffc-e27aeef53bcf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:19:46.877288 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-81076c39-5622-4ed5-bffc-e27aeef53bcf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015209 May 26 21:19:46.877288 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu May 26 21:19:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:19:47.725961 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-0cebe08f-1dfb-4422-a8b8-e38da02c7c17 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:47.727013 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-0cebe08f-1dfb-4422-a8b8-e38da02c7c17 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 26 21:19:47.727417 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:47.914332 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-e5495ec7-b8a0-42bb-b275-e8d073831cc9 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:47.920484 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.wsgi [None req-e5495ec7-b8a0-42bb-b275-e8d073831cc9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-e5495ec7-b8a0-42bb-b275-e8d073831cc9 admin admin] Request method failure captured: May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Accept: application/json May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Accept-Encoding: gzip, deflate May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Connection: keep-alive May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Content-Length: 0 May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Host: 10.222.0.42 May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Openstack-Api-Version: compute 2.90 May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Openstack-System-Scope: None May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: User-Agent: python-novaclient May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Auth-Token: gAAAAABij-7zIzX3xBsmSBrSO72skGBtkCOpdg1wG5cXFVTiAh1QNz7Z_otfeLXXAS5b6e1vJHQ8gVZ5GYCtW6Q9cMsrR64cqHYyOdePJoh3g01eXQjIYKuBmYoKJfWGXgoDuSK3If7fn4yjS764IFMwLXKVylSHjBV1QzPzckWDfjwNoNJ67Cc May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Domain-Id: None May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Domain-Name: None May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Identity-Status: Confirmed May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Is-Admin-Project: True May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Domain-Id: default May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Domain-Name: Default May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Name: admin May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Role: admin,member,reader May 26 21:19:47.921970 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Roles: admin,member,reader May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}] May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant: admin May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant-Name: admin May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User: admin May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Domain-Id: default May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Domain-Name: Default May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Id: ef098ca75a4b4231b612fc38df12339d May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Name: admin May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: method: > May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: exception: Flavor 84 could not be found. May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: action_args: {'id': '84'} May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:19:47.923515 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:47.924645 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:47.926130 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-e5495ec7-b8a0-42bb-b275-e8d073831cc9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:19:47.927372 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-e5495ec7-b8a0-42bb-b275-e8d073831cc9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060898 May 26 21:19:47.927372 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu May 26 21:19:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:19:47.933680 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a4d3b9d-a074-4c3e-906b-2f802379d843 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:47.949720 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a4d3b9d-a074-4c3e-906b-2f802379d843 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019604 May 26 21:19:47.950209 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu May 26 21:19:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:47.959541 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-995d937a-6d51-4104-a656-3b5ddce7d848 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:47.974770 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-995d937a-6d51-4104-a656-3b5ddce7d848 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018665 May 26 21:19:47.975316 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu May 26 21:19:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:47.984588 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-def9025e-7961-4dc2-9e06-23d87ed83ea6 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:47.990470 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.wsgi [None req-def9025e-7961-4dc2-9e06-23d87ed83ea6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-def9025e-7961-4dc2-9e06-23d87ed83ea6 admin admin] Request method failure captured: May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Accept: application/json May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Accept-Encoding: gzip, deflate May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Connection: keep-alive May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Content-Length: 0 May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Host: 10.222.0.42 May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Openstack-Api-Version: compute 2.90 May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Openstack-System-Scope: None May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: User-Agent: python-novaclient May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Auth-Token: gAAAAABij-7zIzX3xBsmSBrSO72skGBtkCOpdg1wG5cXFVTiAh1QNz7Z_otfeLXXAS5b6e1vJHQ8gVZ5GYCtW6Q9cMsrR64cqHYyOdePJoh3g01eXQjIYKuBmYoKJfWGXgoDuSK3If7fn4yjS764IFMwLXKVylSHjBV1QzPzckWDfjwNoNJ67Cc May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Domain-Id: None May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Domain-Name: None May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Identity-Status: Confirmed May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Is-Admin-Project: True May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Domain-Id: default May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Domain-Name: Default May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Name: admin May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Role: admin,member,reader May 26 21:19:47.992027 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Roles: admin,member,reader May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}] May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant: admin May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant-Name: admin May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User: admin May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Domain-Id: default May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Domain-Name: Default May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Id: ef098ca75a4b4231b612fc38df12339d May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Name: admin May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: method: > May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: exception: Flavor 84 could not be found. May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: action_args: {'id': '84'} May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:19:47.993309 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:47.994124 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:47.995180 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-def9025e-7961-4dc2-9e06-23d87ed83ea6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:19:47.996510 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-def9025e-7961-4dc2-9e06-23d87ed83ea6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012407 May 26 21:19:47.996510 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu May 26 21:19:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 21:19:48.863405 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-995d937a-6d51-4104-a656-3b5ddce7d848 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:48.864433 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-995d937a-6d51-4104-a656-3b5ddce7d848 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 21:19:48.864825 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:49.052777 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-8b5ee8df-92b1-4b09-932c-624278995814 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:49.058088 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.wsgi [None req-8b5ee8df-92b1-4b09-932c-624278995814 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-8b5ee8df-92b1-4b09-932c-624278995814 admin admin] Request method failure captured: May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Accept: application/json May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Accept-Encoding: gzip, deflate May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Connection: keep-alive May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Content-Length: 0 May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Host: 10.222.0.42 May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Openstack-Api-Version: compute 2.90 May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Openstack-System-Scope: None May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: User-Agent: python-novaclient May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Auth-Token: gAAAAABij-70BZIl8BRSXOlb1cpouOXVziOKDxTnqdbEoUfzEXlzgS_7GqAlCeI5MmrhPhoRTWvqgvvuU9gxBksZ7y_jbJjwTPyQjMdFjcobYh4OtQjTpYrOhb7OYxFEJckJnFh6HtLmLA8hZ2KKxfbeh2GCGhBvtS4nMexvBWZtkFYxHSN8Ads May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Domain-Id: None May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Domain-Name: None May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Identity-Status: Confirmed May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Is-Admin-Project: True May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Domain-Id: default May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Domain-Name: Default May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Project-Name: admin May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Role: admin,member,reader May 26 21:19:49.059571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Roles: admin,member,reader May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}] May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant: admin May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-Tenant-Name: admin May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User: admin May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Domain-Id: default May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Domain-Name: Default May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Id: ef098ca75a4b4231b612fc38df12339d May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: X-User-Name: admin May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: method: > May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: exception: Flavor 451 could not be found. May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: action_args: {'id': '451'} May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:19:49.061434 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:49.062465 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi May 26 21:19:49.064128 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-8b5ee8df-92b1-4b09-932c-624278995814 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:19:49.065361 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-8b5ee8df-92b1-4b09-932c-624278995814 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060265 May 26 21:19:49.065361 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu May 26 21:19:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:19:49.071556 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-22a1da05-5f3a-4821-8354-9c8ef0e3edb6 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:49.087116 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-22a1da05-5f3a-4821-8354-9c8ef0e3edb6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019726 May 26 21:19:49.087634 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu May 26 21:19:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:19:49.097430 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:49.112137 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018332 May 26 21:19:49.112673 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu May 26 21:19:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:49.121742 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-885f6872-37a0-43f0-9e25-2c5aefc3967e admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:49.126986 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.wsgi [None req-885f6872-37a0-43f0-9e25-2c5aefc3967e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-885f6872-37a0-43f0-9e25-2c5aefc3967e admin admin] Request method failure captured: May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Accept: application/json May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Accept-Encoding: gzip, deflate May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Connection: keep-alive May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Content-Length: 0 May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Host: 10.222.0.42 May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Openstack-Api-Version: compute 2.90 May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Openstack-System-Scope: None May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: User-Agent: python-novaclient May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Auth-Token: gAAAAABij-70BZIl8BRSXOlb1cpouOXVziOKDxTnqdbEoUfzEXlzgS_7GqAlCeI5MmrhPhoRTWvqgvvuU9gxBksZ7y_jbJjwTPyQjMdFjcobYh4OtQjTpYrOhb7OYxFEJckJnFh6HtLmLA8hZ2KKxfbeh2GCGhBvtS4nMexvBWZtkFYxHSN8Ads May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Domain-Id: None May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Domain-Name: None May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Identity-Status: Confirmed May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Is-Admin-Project: True May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Domain-Id: default May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Domain-Name: Default May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Project-Name: admin May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Role: admin,member,reader May 26 21:19:49.128490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Roles: admin,member,reader May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/213a059b002f40c1bddeb6d9f1da1459"}]}] May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant: admin May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant-Id: 213a059b002f40c1bddeb6d9f1da1459 May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-Tenant-Name: admin May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User: admin May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Domain-Id: default May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Domain-Name: Default May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Id: ef098ca75a4b4231b612fc38df12339d May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: X-User-Name: admin May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: method: > May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: exception: Flavor 451 could not be found. May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: action_args: {'id': '451'} May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:19:49.130000 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:49.131422 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi May 26 21:19:49.132523 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-885f6872-37a0-43f0-9e25-2c5aefc3967e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:19:49.133514 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-885f6872-37a0-43f0-9e25-2c5aefc3967e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011599 May 26 21:19:49.133514 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu May 26 21:19:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:19:49.995539 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:49.996571 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 26 21:19:49.996965 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:50.184952 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-fd07336c-c75f-4e14-8feb-52bf7cf3bb0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:50.251779 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-fd07336c-c75f-4e14-8feb-52bf7cf3bb0a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.118393 May 26 21:19:50.252231 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu May 26 21:19:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:51.117028 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:51.118071 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 26 21:19:51.118463 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:51.307270 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-004c5306-3a6c-4439-ba49-55438cab357b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:51.376930 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-004c5306-3a6c-4439-ba49-55438cab357b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.122358 May 26 21:19:51.377490 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu May 26 21:19:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:52.246472 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:52.247476 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 26 21:19:52.247898 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:52.436121 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-1e1b110d-4a46-4d7f-8ca6-af81cf3596d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:52.510216 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-1e1b110d-4a46-4d7f-8ca6-af81cf3596d1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.125842 May 26 21:19:52.510757 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu May 26 21:19:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:53.366972 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:53.368037 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 26 21:19:53.368437 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:53.555860 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-08d115a7-71f5-42bb-a831-52efcfe8065f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:19:53.674933 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-08d115a7-71f5-42bb-a831-52efcfe8065f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.171124 May 26 21:19:53.675489 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu May 26 21:19:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:54.546183 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:54.547189 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 26 21:19:54.547591 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:54.735471 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-f078ab1b-d86f-4bcb-af2e-e6e45a40eb9d admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:54.754407 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-f078ab1b-d86f-4bcb-af2e-e6e45a40eb9d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071970 May 26 21:19:54.754874 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu May 26 21:19:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:20:57.864984 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:20:57.866256 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-f57df244-ae71-4410-b884-a2f3465ac121 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002604 May 26 21:20:57.866876 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 26 21:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:20:57.876656 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.934027 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-dd0365c9-f9e6-42c8-afa4-a8a3629cecc2 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:20:57.954834 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-dd0365c9-f9e6-42c8-afa4-a8a3629cecc2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079547 May 26 21:20:57.955415 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 26 21:20:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:20:57.977260 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_api:SELECT=14 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.981147 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-87226227-bf9d-4b3f-a04d-54d124bb3f2a admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:20:57.989944 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-87226227-bf9d-4b3f-a04d-54d124bb3f2a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014036 May 26 21:20:57.990516 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Thu May 26 21:20:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:20:58.003198 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-5ba6d90d-0057-4ded-b8a1-910a34586a06 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:20:58.015087 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-5ba6d90d-0057-4ded-b8a1-910a34586a06 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015504 May 26 21:20:58.016093 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Thu May 26 21:20:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:20:58.033753 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:20:58.042691 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012655 May 26 21:20:58.043272 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Thu May 26 21:20:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:20:58.059147 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-8bb542af-d904-4594-8bdf-0e0ebc9fbfc3 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:20:58.072813 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-8bb542af-d904-4594-8bdf-0e0ebc9fbfc3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019248 May 26 21:20:58.073848 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Thu May 26 21:20:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:49.284076 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:49.285356 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 May 26 21:24:49.285759 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:49.451953 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=6 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:49.578910 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-6b4a157d-99ba-4266-ae2e-a80d1b8f6bd1 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:49.580192 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:24:49.580192 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: warnings.warn(msg) May 26 21:24:49.582105 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-6b4a157d-99ba-4266-ae2e-a80d1b8f6bd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.582548 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-6b4a157d-99ba-4266-ae2e-a80d1b8f6bd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.583432 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-6b4a157d-99ba-4266-ae2e-a80d1b8f6bd1 admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.583807 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-6b4a157d-99ba-4266-ae2e-a80d1b8f6bd1 admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.620361 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-6b4a157d-99ba-4266-ae2e-a80d1b8f6bd1 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.169995 May 26 21:24:49.620933 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu May 26 21:24:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:24:50.506374 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:50.507436 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 May 26 21:24:50.507870 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:50.722508 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-894791fa-b428-4e51-ac8e-61a07b69145b admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:50.723891 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:24:50.723891 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: warnings.warn(msg) May 26 21:24:50.725289 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-894791fa-b428-4e51-ac8e-61a07b69145b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:50.725734 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-894791fa-b428-4e51-ac8e-61a07b69145b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:50.726522 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-894791fa-b428-4e51-ac8e-61a07b69145b admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:50.726947 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-894791fa-b428-4e51-ac8e-61a07b69145b admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:50.748231 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-894791fa-b428-4e51-ac8e-61a07b69145b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.098471 May 26 21:24:50.748814 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu May 26 21:24:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:25:02.067565 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:02.068618 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 26 21:25:02.069022 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:25:02.211873 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell0:SELECT=4 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:02.212622 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell1:SELECT=4 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:02.213237 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=8 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:02.262811 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-fd8944b2-7e77-4a7e-9960-8e329da480c6 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:02.264740 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:25:02.264740 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: warnings.warn(msg) May 26 21:25:02.265376 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-fd8944b2-7e77-4a7e-9960-8e329da480c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:02.265804 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-fd8944b2-7e77-4a7e-9960-8e329da480c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:02.266581 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-fd8944b2-7e77-4a7e-9960-8e329da480c6 admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:02.267033 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-fd8944b2-7e77-4a7e-9960-8e329da480c6 admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:02.293353 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-fd8944b2-7e77-4a7e-9960-8e329da480c6 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085103 May 26 21:25:02.293353 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu May 26 21:25:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:03.178917 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:03.180046 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-194a247c-60b5-455a-974c-6731d2a7b66c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 May 26 21:25:03.180463 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu May 26 21:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:25:03.388707 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-e46e439c-aa29-462c-9e54-3cff4293b619 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:03.389883 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:25:03.389883 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: warnings.warn(msg) May 26 21:25:03.391200 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-e46e439c-aa29-462c-9e54-3cff4293b619 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:03.391641 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-e46e439c-aa29-462c-9e54-3cff4293b619 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:03.392498 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-e46e439c-aa29-462c-9e54-3cff4293b619 admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:03.393454 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-e46e439c-aa29-462c-9e54-3cff4293b619 admin admin] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:03.416689 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-e46e439c-aa29-462c-9e54-3cff4293b619 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094934 May 26 21:25:03.417282 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu May 26 21:25:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:02.253679 dv-cinder-828805-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 21:26:02.254530 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: Thu May 26 21:26:02 2022 - graceful shutdown triggered... May 26 21:26:02.255011 dv-cinder-828805-3-iscsi devstack@n-api.service[103901]: Gracefully killing worker 1 (pid: 103901)... May 26 21:26:02.255898 dv-cinder-828805-3-iscsi devstack@n-api.service[103902]: Gracefully killing worker 2 (pid: 103902)... May 26 21:26:03.255492 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: worker 1 buried after 1 seconds May 26 21:26:03.255492 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: worker 2 buried after 1 seconds May 26 21:26:03.255492 dv-cinder-828805-3-iscsi devstack@n-api.service[103900]: goodbye to uWSGI. May 26 21:26:03.257141 dv-cinder-828805-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 21:26:03.257710 dv-cinder-828805-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 21:26:03.260417 dv-cinder-828805-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 21:26:03.278392 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 21:26:03 2022] *** May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: nodename: dv-cinder-828805-3-iscsi May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: machine: x86_64 May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: clock source: unix May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: pcre jit disabled May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: detected number of CPU cores: 4 May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: current working directory: / May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: detected binary path: /usr/bin/uwsgi-core May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: your processes number limit is 47680 May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: your memory page size is 4096 bytes May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: detected max file descriptor number: 2048 May 26 21:26:03.292925 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: lock engine: pthread robust mutexes May 26 21:26:03.294069 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: thunder lock: enabled May 26 21:26:03.294069 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 21:26:03.294069 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 21:26:03.340391 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: Python main interpreter initialized at 0x55987ea359c0 May 26 21:26:03.340391 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: python threads support enabled May 26 21:26:03.340391 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: your server socket listen backlog is limited to 100 connections May 26 21:26:03.340391 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: your mercy for graceful operations on workers is 90 seconds May 26 21:26:03.340843 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: mapped 403077 bytes (393 KB) for 2 cores May 26 21:26:03.340843 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: *** Operational MODE: preforking *** May 26 21:26:03.341118 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: *** uWSGI is running in multiple interpreter mode *** May 26 21:26:03.341118 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: spawned uWSGI master process (pid: 118543) May 26 21:26:03.341337 dv-cinder-828805-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 21:26:03.342025 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: spawned uWSGI worker 1 (pid: 118557, cores: 1) May 26 21:26:03.342323 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: spawned uWSGI worker 2 (pid: 118558, cores: 1) May 26 21:26:03.342482 dv-cinder-828805-3-iscsi devstack@n-api.service[118543]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 21:26:04.551466 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:26:04.552451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:26:05.351720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:26:05.351720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: from cryptography.utils import int_from_bytes May 26 21:26:05.352199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:26:05.352199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: from cryptography.utils import int_from_bytes May 26 21:26:05.352355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:26:05.352355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: from cryptography.utils import int_from_bytes May 26 21:26:05.352569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:26:05.352569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: from cryptography.utils import int_from_bytes May 26 21:26:07.808771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:26:07.809331 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:26:07.809414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:26:07.809414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:26:07.809867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:26:07.809943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:26:07.810021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:26:07.810103 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:26:07.810173 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:26:07.810652 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:26:07.810771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.810848 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.810926 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.811120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.811216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.811428 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.811548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.811787 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.811916 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.812118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.812219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.812425 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.812530 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.812753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.812862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813662 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813760 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.813983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.814066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-3-iscsi {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.814308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-3-iscsi {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.814473 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.814622 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.814769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.814917 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.815068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.815220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.815371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.815518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.815663 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.815876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.816043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.816343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.816513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.816665 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.816814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.818382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.818633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.818852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.819074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.819289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.819512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.819735 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.819983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.820200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.820405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.820620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.820842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.821047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.821265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.821470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.821706 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.821910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.822153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.822370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.822586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.822796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.823009 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-3-iscsi {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.823229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-3-iscsi {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.823458 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.823643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.823903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.824091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.824251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.824404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.825323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.825562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.825726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.825878 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.826030 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.826179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.826321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.826471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.826979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.827142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.827286 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.827428 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.827830 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.827998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.828143 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.828310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.828462 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.828615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.828766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.828923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.829072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.829299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.829455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.829597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.829750 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.829898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.830045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.830209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.830353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.830500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.830746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.830895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.831047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.831190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.831341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.831489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.831630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.832360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.832623 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.832771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.832925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.832925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.833204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.833358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.833507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.833507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.833823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.833974 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.834127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.834287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.834448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.834601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.834774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.835465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.835632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.835828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.835986 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.836131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.836280 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.836422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.836573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.836725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.836873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.837028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.837176 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.837317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.837473 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.837642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.837642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.838141 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.838885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839048 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839638 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839816 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.839816 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840402 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840402 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.840993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.841146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.841289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.841430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.841590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.841747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.841889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.842030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.842178 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.842322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.842476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.842649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.842886 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.843950 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844681 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844829 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.844976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.845645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.845807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.846103 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.846283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.846436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.846584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.846725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.846885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.847034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.847190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.847339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.850858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.851051 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.851206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.851367 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.851521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.851695 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.851876 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.852039 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.852193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.852335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.852482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.852632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.852775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853600 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.853911 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854351 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854795 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.854949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.855100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.855828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856754 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.856903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.857950 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858112 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.858994 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.859141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.859283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.859432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.859585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.859833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.859984 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.860147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.860289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.860429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.860576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.860743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861248 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861397 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861689 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.861982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.862124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.862283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.862425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.862584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.862730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.862881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.863040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.863274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.863429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.863584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.863726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.863952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.864218 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.864382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.864537 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.864695 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:26:07.864838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.864985 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.865126 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.865273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.865917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866667 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.866984 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.867126 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.867274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.867422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.867564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.867713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.867890 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.868921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869512 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869662 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869811 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.869960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.870101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.870241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.870390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.870543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.870692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.870840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.871005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.871323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.871486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.871637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.871817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.871973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.872122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.872277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.872430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.872572 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.872730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.872873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873411 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873566 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.873990 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.874145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.874294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.874442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.874589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.874742 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.874900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.876416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.876582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.876740 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.876886 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.877937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.878089 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.878241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.878391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.878538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.879180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.879334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.879485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.879634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.879830 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.879981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.880131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.880281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.880447 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.880589 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.880737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.880883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.881028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.881177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.881543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.881701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.881844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882453 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882759 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.882906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.883048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.883199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.883342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.883576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.883576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.883888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.884040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.884212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.884493 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.884649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.884810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.884952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.885100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.885257 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.885407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.885556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.886138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.886298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.886441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.886593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.886735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.886876 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.887029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.887178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.887341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.887485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.887640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.887850 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888317 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.888902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889845 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.889993 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.890149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.890291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.890432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.890574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.890714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.890868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.891028 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.891178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.891337 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.891789 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.891944 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.892994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.893147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.893147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.893423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.893588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.893777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.893938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.894080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.894231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.894974 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.895192 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.895354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.895506 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.895656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.896209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.896209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.896514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.896666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.896810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.896958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897258 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897401 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.897984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.898135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.898276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.898426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.898569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.898711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.898859 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899605 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.899922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900801 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.900953 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.901095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.901237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.901384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.901539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.901934 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.902095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.902249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.902398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.902601 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.902747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.902903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.903055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.903204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.903346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.903486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.903634 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.903806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904170 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904751 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.904902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.905043 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.905210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.905424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.905572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.905728 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.905893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.906389 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.906566 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.906710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.906852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907300 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907581 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.907907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908683 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.908979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.909119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.909260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.909408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.909568 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.909710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.909858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.910038 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.910188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.910346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.910515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.910664 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.910889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.911053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.911255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.911421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.911589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.911777 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.912180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.912355 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.912506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.912663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.912819 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.912977 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.913124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.913278 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.913425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.913585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.913741 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.913889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914483 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.914949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.915106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.915254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.915429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.915658 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.915846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.916012 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.916514 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.916691 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.916850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917321 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917470 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917632 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.917937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.918084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.918238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.918386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.918553 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.918726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.919015 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.919191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.919350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.919517 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.919675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.919883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.920043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.920199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.920354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.920583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.920734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.920889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.921053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.921208 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.921363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.921530 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.921699 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.921848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.922012 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.922409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.922573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.922732 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.922889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923039 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923815 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.923979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.924128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.924285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.924443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.924599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.924747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.924901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.925056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.925213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.925370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.925518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.925833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.925997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.926160 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.926677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.926847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927159 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927308 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927456 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927603 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.927984 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.928141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.928297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.928574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.928738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.928895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929051 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929671 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.929975 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.930122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.930542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.930692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.930863 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.931710 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.931912 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.932073 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.932240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.932595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.932856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.933025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.933184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.933334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.933334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.933639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.933856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.934023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.934023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.934423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.934637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.934798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.934954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.935114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.935277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.935427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.935576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.935732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.936054 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.936231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.936400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.936956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.937128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.937293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.937442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.937596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.937757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.937919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.938075 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.938232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.938399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.938554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.938714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.938870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939025 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939025 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939636 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.939977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.940129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.940278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.940444 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.940600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.940756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.940904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.941060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.941747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.941918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.942078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.942235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.942383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.942743 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943356 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943514 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.943992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.944158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.944316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.944472 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.944856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.945010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.945174 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.945323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.945472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.945632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.945776 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.946279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.946548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.946548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.947945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948036 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.948746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949037 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949473 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949557 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949830 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.949919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950175 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950266 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.950956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951129 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951472 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951653 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.951968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952062 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952145 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952577 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952752 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.952941 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953216 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953499 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.953944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954727 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954900 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.954981 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955062 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955244 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.955899 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956482 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.956893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.957693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.957790 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.957883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.957973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958250 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.958954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959039 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959308 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.959907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960173 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960859 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.960941 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961454 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961629 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.961991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962253 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962433 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.962927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963303 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963457 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963628 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963711 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963809 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.963998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964717 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964809 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.964901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965580 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965664 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965913 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.965913 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966252 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.966918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967355 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.967923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968015 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968373 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968712 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.968986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.969927 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970591 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970707 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.970926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971089 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.971937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972299 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972789 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.972898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.973901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974009 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974340 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.974908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975437 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975619 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.975933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976306 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976751 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.976922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977164 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977234 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977552 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.977989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.978074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.978167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.978338 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.978486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.978729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.978883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.979000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.979107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.979319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.979426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.979798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.979912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980264 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.980897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981015 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981310 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981623 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.981950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.982146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.982257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.982469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.982576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.982786 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.982900 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.983113 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.983217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.983440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.983544 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.983767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.983886 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.984093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.984204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.984406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.984533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.984715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.984876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985125 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.985983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.986074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.986307 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.986407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.986640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.986738 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.986971 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.987061 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.987293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.987421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.987629 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.987731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.987983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.988122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.988324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.988446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.988643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.988745 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.988953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989267 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989377 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.989985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.990190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.990291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.990497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.990607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.990804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.990906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.991113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.991212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.991429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.991528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.991729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.991873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.992069 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.992396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.992703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.993865 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.993972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994226 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.994955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.995104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.995453 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.995607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.995771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.995771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996058 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.996930 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.997063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.997198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.997352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.997451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.997652 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.997767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.998166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.998304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.998452 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.998593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.998733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.998881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999160 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999307 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:07.999989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.000147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.000288 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.000389 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.000527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.000674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.000952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.001099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.001273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.001418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.001593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.001738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.001895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.002041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.002212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.002347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.002550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.002744 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.002892 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.003038 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.003178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.003316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.003464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.003603 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.004297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.004446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.004599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.004878 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.005212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.005364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.005508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.005648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.005784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.005934 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.006950 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007096 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.007976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.008316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.008467 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.008597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.008762 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.008900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009172 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009438 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009699 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.009955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.010163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.010295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.010429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.010564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.010747 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.010889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.011065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.011198 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.011384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.011515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.011707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.011883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.012067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.012204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.012411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.012544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.012726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.012870 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.013044 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.013185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.013364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.013565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.013707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.013881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.014208 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.014348 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.014532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.014662 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.014862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.014990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.015178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.015282 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.015500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.015621 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.015854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.016942 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.017154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.017256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.017475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.017583 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.017851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.017960 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.018103 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.018201 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.018441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.018561 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.018828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.018931 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.019065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.019163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.019982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.020197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.020299 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.020554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.020843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.020934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.021192 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.021291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.021516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.021607 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.021835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.021924 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.022144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.022237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.022471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.022570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.022779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.022880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.023089 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.023181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.023412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.023508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.023724 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.023869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.024070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.024162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.024392 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.024482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.024705 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.024797 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025022 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025420 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025540 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025879 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.025993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.026082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.026264 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.026378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.026575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.026688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.026904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.027004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.027213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.027313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.027525 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.027641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.027902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.028215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.028534 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.028843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.028937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.029156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.029251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.029488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.029610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.029836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030494 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.030994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.031134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.031290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.031438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.031584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.031726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035859 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.035947 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036022 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036742 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.036947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037288 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037586 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037664 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037742 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.037984 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.038074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.038154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.038225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.038295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.038374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039663 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.039966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040087 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040305 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.040890 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041144 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041575 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.041910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042258 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042474 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.042943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.043111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.043236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.043434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.043573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.043789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.043911 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.047978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048197 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048632 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.048917 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.049958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050744 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.050922 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051639 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.051939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052490 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052742 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.052930 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053439 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053608 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.053837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054161 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.054818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.055035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.055127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.055599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.055718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.055939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056058 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056641 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.056949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.057161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.057261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.057466 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.057558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.057812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.057918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.058122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.058222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.058436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.058534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.058743 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.058945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.059177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.059504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.059645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.059915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.059915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060576 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.060969 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061506 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.061966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062094 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.062854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.063054 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.063172 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.063367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.063495 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.063769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.063910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064572 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.064988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.065117 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.065301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.065429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.065614 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.065741 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.065985 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.066122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.066773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.066893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.067087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.067205 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.067416 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.067532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.067757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.067895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.068079 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.068222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.068404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.068545 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.068721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.068854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.069036 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.069187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.069567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.069710 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.069856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.069985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.070126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.070374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.070374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.070638 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.071452 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.071627 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.071813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.071932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.077608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.077740 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.077838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.077924 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078007 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078175 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078358 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078699 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.078903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079016 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.079891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:26:08.080060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.080060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:26:08.080060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:26:08.134920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO dbcounter [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Registered counter for database nova_api May 26 21:26:08.135458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO dbcounter [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Registered counter for database nova_api May 26 21:26:08.156173 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_db.sqlalchemy.engines [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.157662 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_db.sqlalchemy.engines [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.163997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writer thread running {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.165065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writer thread running {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.220722 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.context [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32e2bb36-b7b6-4358-a218-787992281ee0(cell1) {{(pid=118557) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:26:08.221641 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.context [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32e2bb36-b7b6-4358-a218-787992281ee0(cell1) {{(pid=118558) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:26:08.224955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.225788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.226544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.227348 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.227457 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.228183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.229351 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.230232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.231332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO dbcounter [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Registered counter for database nova_cell0 May 26 21:26:08.232233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO dbcounter [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Registered counter for database nova_cell0 May 26 21:26:08.235361 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO dbcounter [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Registered counter for database nova_cell1 May 26 21:26:08.236312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO dbcounter [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Registered counter for database nova_cell1 May 26 21:26:08.243596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_db.sqlalchemy.engines [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.245503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_db.sqlalchemy.engines [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.248419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_db.sqlalchemy.engines [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.248853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writer thread running {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.249539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_db.sqlalchemy.engines [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.254577 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writer thread running {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.257359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writer thread running {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.396043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writer thread running {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.404964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO dbcounter [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Registered counter for database nova_cell0 May 26 21:26:08.405187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO dbcounter [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Registered counter for database nova_cell0 May 26 21:26:08.412220 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_db.sqlalchemy.engines [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.414319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_db.sqlalchemy.engines [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:26:08.419331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writer thread running {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.420585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writer thread running {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:26:08.743823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: WARNING keystonemiddleware.auth_token [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:26:08.751154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: WARNING keystonemiddleware.auth_token [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:26:08.752490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: WARNING keystonemiddleware.auth_token [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:26:08.760257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: WARNING keystonemiddleware.auth_token [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:26:09.100960 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: WARNING keystonemiddleware.auth_token [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:26:09.107024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: WARNING keystonemiddleware.auth_token [None req-733b8f47-a688-4d6d-9ddd-d9d8a049107d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:26:09.112237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: WARNING keystonemiddleware.auth_token [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:26:09.112706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55987ea359c0 pid: 118557 (default app) May 26 21:26:09.119255 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: WARNING keystonemiddleware.auth_token [None req-6162d85d-f02b-472c-99df-24b5f70ca036 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:26:09.124803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55987ea359c0 pid: 118558 (default app) May 26 21:26:52.235915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:52.237219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:52.242070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:52.244223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:54.149010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fe7684f7-e0db-46ee-83bc-8924203f8b2e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Action: 'create', calling method: .version_select at 0x7f7bc7420ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-209379483"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:54.392316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:54.395487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:54.397818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:54.401156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:55.774257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0f9f5d53-9a7b-470b-8505-611571c62abe tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Action: 'create', calling method: .version_select at 0x7f7bc741fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-343610277", "metadata": {"Type": "work"}}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:57.172991 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fe7684f7-e0db-46ee-83bc-8924203f8b2e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.951648 May 26 21:26:57.176528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Thu May 26 21:26:52 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4960 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 21:26:57.522586 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-570114089", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "networks": [{"uuid": "49e4975b-6869-4462-9c74-3db9f1965109"}]}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:57.978274 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] validate_networks() for [('49e4975b-6869-4462-9c74-3db9f1965109', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:26:58.558810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0f9f5d53-9a7b-470b-8505-611571c62abe tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.190600 May 26 21:26:58.559461 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1155 bytes} [Thu May 26 21:26:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4195 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 21:26:58.566880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-de0d22c9-62a3-4cce-af80-84a0b38e5ad1 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc726dc10>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:58.721731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-de0d22c9-62a3-4cce-af80-84a0b38e5ad1 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f" status: 200 len: 345 microversion: 2.1 time: 0.160182 May 26 21:26:58.722964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:26:58 2022] GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f => generated 345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:58.735382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f7c1315e-e784-4b1c-9aa5-149a9d993eb2 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc726ddc0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:58.864201 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f7c1315e-e784-4b1c-9aa5-149a9d993eb2 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 352 microversion: 2.1 time: 0.138428 May 26 21:26:58.864201 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:26:58 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:58.870998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ec822d6d-2e47-43a4-961b-6a79ade37097 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Action: 'create', calling method: .version_select at 0x7f7bc72833a0>, body: {"snapshot": {"volume_id": "4f021d19-f08f-46d7-9006-2e0fab1e793f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1859931446"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:59.459867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:26:59.460500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:26:59.460893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:26:59.461682 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:26:59.462691 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:26:59.481152 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:59.481969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.483228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:59.483989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.530137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Getting quotas for project 199159bff7e5433ca3da168465c2e22c. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:26:59.540976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Getting quotas for user 71302686cd59424ba952b49c0fad3577 and project 199159bff7e5433ca3da168465c2e22c. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:26:59.582465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:26:59.590608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:26:59.680114 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ec822d6d-2e47-43a4-961b-6a79ade37097 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.809185 May 26 21:26:59.680114 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 4/5] 10.222.0.42 () {60 vars in 1161 bytes} [Thu May 26 21:26:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:59.689458 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6bb444ed-ce32-4605-92bc-c5738ffe2ef5 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc728e040>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:59.744243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6bb444ed-ce32-4605-92bc-c5738ffe2ef5 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.059146 May 26 21:26:59.745019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 5/6] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:26:59.756330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-59525dee-26a8-4236-a627-9fce8e12ffc0 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc7283c10>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:59.811454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-00a2cdba-ceff-4f23-bd49-d61ebb308ca8 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.631952 May 26 21:26:59.812507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 2/7] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:26:59.826091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9be61f55-2d55-4f95-917a-ecc60daea807 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:59.826900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9be61f55-2d55-4f95-917a-ecc60daea807 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:59.850316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-59525dee-26a8-4236-a627-9fce8e12ffc0 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.099091 May 26 21:26:59.851120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 6/8] 10.222.0.42 () {58 vars in 1139 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:26:59.864187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bff1a7cc-0d0e-4ab3-8ba4-cb774a5c8e10 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc726da60>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:59.974045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bff1a7cc-0d0e-4ab3-8ba4-cb774a5c8e10 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.114308 May 26 21:26:59.974874 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 7/9] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:26:59.981883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-00b81b72-f8ad-46e6-87c6-dfba5e6e4831 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc728e310>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:00.085298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-00b81b72-f8ad-46e6-87c6-dfba5e6e4831 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 353 microversion: 2.1 time: 0.108902 May 26 21:27:00.086275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 8/10] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:00.099350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-73fdd7af-24f6-4b74-bafa-851b7d6a3f76 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc726daf0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:00.133224 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9be61f55-2d55-4f95-917a-ecc60daea807 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:00.158761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9be61f55-2d55-4f95-917a-ecc60daea807 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1214 microversion: 2.1 time: 0.338694 May 26 21:27:00.159575 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 3/11] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1214 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:00.224386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-73fdd7af-24f6-4b74-bafa-851b7d6a3f76 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 353 microversion: 2.1 time: 0.130298 May 26 21:27:00.225644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 9/12] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:00 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:00.243227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d6940ebd-b582-4753-97a3-a50e86064f13 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc612aaf0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:00.633677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d6940ebd-b582-4753-97a3-a50e86064f13 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 202 len: 0 microversion: 2.1 time: 0.398205 May 26 21:27:00.634952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 4/13] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:27:00 2022] DELETE /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:27:00.651308 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e9111bfa-67bb-408f-b91e-c75d9d4a994c tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc7283550>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:00.924593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e9111bfa-67bb-408f-b91e-c75d9d4a994c tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 352 microversion: 2.1 time: 0.283145 May 26 21:27:00.926536 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 10/14] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:00 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:01.005516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4afb468d-a2ba-4626-9ca8-c0730788f15c tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc613ce50>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:01.181310 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-24004e06-9739-4c81-b2c3-1977ea4c6673 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:01.182706 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-24004e06-9739-4c81-b2c3-1977ea4c6673 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:01.236355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4afb468d-a2ba-4626-9ca8-c0730788f15c tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.250357 May 26 21:27:01.237419 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 5/15] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:00 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:01.663832 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-24004e06-9739-4c81-b2c3-1977ea4c6673 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:01.690359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-24004e06-9739-4c81-b2c3-1977ea4c6673 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1214 microversion: 2.1 time: 0.517226 May 26 21:27:01.701933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 11/16] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:01 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1214 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:01.944565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b91a1e09-33e3-4fc3-860e-46d9bbdd7c79 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc614d5e0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:02.067816 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b91a1e09-33e3-4fc3-860e-46d9bbdd7c79 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 352 microversion: 2.1 time: 0.130823 May 26 21:27:02.068724 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 6/17] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:01 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:02.252123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-198ed9da-fdf5-4304-a4e9-18b5895abb9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc7283f70>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:02.309938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-198ed9da-fdf5-4304-a4e9-18b5895abb9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.062085 May 26 21:27:02.311007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 12/18] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:02 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:02.714579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d218f165-371c-40fa-b130-01aea9ab36a5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:02.715218 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d218f165-371c-40fa-b130-01aea9ab36a5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:02.932449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d218f165-371c-40fa-b130-01aea9ab36a5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:02.950670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d218f165-371c-40fa-b130-01aea9ab36a5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1214 microversion: 2.1 time: 0.246192 May 26 21:27:02.974607 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 7/19] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:02 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:03.086932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0364ddd2-89e3-4fee-9986-8aab7624c514 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc724e820>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:03.225418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0364ddd2-89e3-4fee-9986-8aab7624c514 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 352 microversion: 2.1 time: 0.144331 May 26 21:27:03.226941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 13/20] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:03 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:03.329152 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b3603352-0481-41c4-87c4-88291d99e52f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc614d430>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:03.467704 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b3603352-0481-41c4-87c4-88291d99e52f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.145859 May 26 21:27:03.468287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 8/21] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:03 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:03.978105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:03.979550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:04.004542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:04.005363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:04.009443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:04.010147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:04.243824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-12e82c54-4f9d-44eb-b1ca-6b35948ba1dc tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc614d4c0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:04.390942 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-12e82c54-4f9d-44eb-b1ca-6b35948ba1dc tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 352 microversion: 2.1 time: 0.153119 May 26 21:27:04.391718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 9/22] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:04 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:04.447640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:04.481951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b85ab91c-d848-45e8-980b-f755244aeb7a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc6987a60>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:04.483435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-eddbb71f-4191-406f-96c4-deebb5631a27 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1218 microversion: 2.1 time: 0.516200 May 26 21:27:04.493613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 14/23] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:03 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1218 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:04.534089 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b85ab91c-d848-45e8-980b-f755244aeb7a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.056112 May 26 21:27:04.535717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 10/24] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:04 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:05.408004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5279f07-0950-4999-82fb-6a1705bbde4b tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc71d79d0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:05.501935 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:05.502759 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:05.516062 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e5279f07-0950-4999-82fb-6a1705bbde4b tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 200 len: 352 microversion: 2.1 time: 0.115839 May 26 21:27:05.521651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 15/25] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:05 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:05.530914 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:05.531672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:05.533137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:05.535030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:05.548986 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8b08baef-4248-4b3d-9b80-e10d52a16b18 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc71d7940>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:05.605000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8b08baef-4248-4b3d-9b80-e10d52a16b18 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.062399 May 26 21:27:05.606710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 16/26] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:05 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:05.814528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-79f2e8d8-d287-47a0-bdc0-57c9b1db7590 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'create', calling method: .version_select at 0x7f7bc71d75e0>, body: {"keypair": {"name": "tempest-keypair-1027092613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE7oRJgDDfCQgZMujdUKqPxawgjpnHrF0bejM9qe4ekpVGja9GuXrWdQAGLceyJGPJ0ZDspg08I+8WcLlGmrHSZFHgtHVIRm7DKq5r2rIZUKMtf0UoYBvFSN7aw0e8Bdg=="}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:05.823186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:05.851040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8d6b12f9-3a40-4fbc-a434-40882ca53961 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1218 microversion: 2.1 time: 0.353411 May 26 21:27:05.851634 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 11/27] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:05 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1218 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:05.934281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-79f2e8d8-d287-47a0-bdc0-57c9b1db7590 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for project c5f69588fe354d20b58594919deb4110. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:27:05.960896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-79f2e8d8-d287-47a0-bdc0-57c9b1db7590 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for user 9b94748ea78342629281f2360a54bee4 and project c5f69588fe354d20b58594919deb4110. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:27:06.118275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-79f2e8d8-d287-47a0-bdc0-57c9b1db7590 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.510220 May 26 21:27:06.125945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 17/28] 10.222.0.42 () {62 vars in 1199 bytes} [Thu May 26 21:27:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 512 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 21:27:06.536451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d2f9efa1-5a99-4218-a8f5-8d29a9cea756 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Calling method '.version_select at 0x7f7bc60c1670>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:06.620358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1452dfcd-079e-49e0-be56-133c4bc54fa2 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc7114280>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:06.634971 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-d2f9efa1-5a99-4218-a8f5-8d29a9cea756 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] HTTP exception thrown: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d2f9efa1-5a99-4218-a8f5-8d29a9cea756 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Request method failure captured: May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 HTTP/1.1 May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Ce9iyoe2QLGKw8I8Ak16kYQsQU6M2fwiWjkL-ozpev-fI1u_85PZbwAVgykk7XSDJd2jRUruTw4Og853XwwgUZCk8l0urlVgzoIkB5RElOit776-pFRwAaAb_EBoKdtIKqf4H7ecGlo1eYTxQmSKnYE8qlljbt-d_wv5rfQ0fGnAQ May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 6f94cb4b483c44869229b4b073c19d96 May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesGetTestJSON-1589329315 May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:27:06.639701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f94cb4b483c44869229b4b073c19d96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f94cb4b483c44869229b4b073c19d96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f94cb4b483c44869229b4b073c19d96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f94cb4b483c44869229b4b073c19d96"}]}] May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesGetTestJSON-1589329315 May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 6f94cb4b483c44869229b4b073c19d96 May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesGetTestJSON-1589329315 May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesGetTestJSON-1589329315-project May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: ddc77b5aa7c6444f8bead90df7b9bdf8 May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesGetTestJSON-1589329315-project May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '2992c82e-499a-4e34-b81f-06f01408c466'} May 26 21:27:06.640782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. (HTTP 404) (Request-ID: req-9fc590d7-7e81-473f-91e2-a602a01a6054) May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:06.641434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:06.642291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:27:06.643179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d2f9efa1-5a99-4218-a8f5-8d29a9cea756 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] Returning 404 to user: Volume 2992c82e-499a-4e34-b81f-06f01408c466 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:27:06.644207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d2f9efa1-5a99-4218-a8f5-8d29a9cea756 tempest-VolumesGetTestJSON-1589329315 tempest-VolumesGetTestJSON-1589329315-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466" status: 404 len: 109 microversion: 2.1 time: 0.110461 May 26 21:27:06.646839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 12/29] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:06 2022] GET /compute/v2.1/os-volumes/2992c82e-499a-4e34-b81f-06f01408c466 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:27:06.716952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1452dfcd-079e-49e0-be56-133c4bc54fa2 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 288 microversion: 2.1 time: 0.102090 May 26 21:27:06.718187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 18/30] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:06 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:06.728688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b34b6f37-c305-4c31-b882-fc212cfc92d2 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc6077430>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:06.869762 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:06.870559 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:06.891452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:06.897347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:06.898529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:06.901468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:06.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b34b6f37-c305-4c31-b882-fc212cfc92d2 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 202 len: 0 microversion: 2.1 time: 0.265127 May 26 21:27:06.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 13/31] 10.222.0.42 () {58 vars in 1253 bytes} [Thu May 26 21:27:06 2022] DELETE /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:27:06.999080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ec35fafb-a207-45b1-b6f8-fbc9127890b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc6077af0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:07.071891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:07.080487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ec35fafb-a207-45b1-b6f8-fbc9127890b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 200 len: 287 microversion: 2.1 time: 0.085236 May 26 21:27:07.081047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 14/32] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:06 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:07.085186 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-82c77b2b-cf0e-4acf-ab6b-43266dc3e14c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1266 microversion: 2.1 time: 0.220776 May 26 21:27:07.087039 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:06 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:08.094145 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fcd9e330-8dcf-47c3-a901-2ba79cac7b9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc6077dc0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:08.107168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:08.108774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:08.120339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:08.125248 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:08.125248 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:08.125248 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:08.171246 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-fcd9e330-8dcf-47c3-a901-2ba79cac7b9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] HTTP exception thrown: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fcd9e330-8dcf-47c3-a901-2ba79cac7b9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Request method failure captured: May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe HTTP/1.1 May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_CcU_ai99tpy-DtKQPNvJGdayq8jkLn-YwWQMMBe7uEvqCH15NiUcknzsTFkGGVgeU5r_IHEr9jnVVEruK0lTM6ZpafkcWrg5Bp2nE1LI8yc3_x91qEUWg7Vdv5PW_i1LGZ6wcwYa_hUlx8rtIehOWrU3QQLlKUTvtI0vkv6hplAXo May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:27:08.176519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}] May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 5c66120fd1124221b4a5552ddb6cd145 May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '870c5b19-52ed-4d07-b634-f3dace796bbe'} May 26 21:27:08.177802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. (HTTP 404) (Request-ID: req-9bad3832-3b8f-40bb-b6f7-6f7cd023ce85) May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:08.179269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 21:27:08.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fcd9e330-8dcf-47c3-a901-2ba79cac7b9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Returning 404 to user: Snapshot 870c5b19-52ed-4d07-b634-f3dace796bbe could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:27:08.181674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fcd9e330-8dcf-47c3-a901-2ba79cac7b9a tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe" status: 404 len: 111 microversion: 2.1 time: 0.085341 May 26 21:27:08.183958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:27:08 2022] GET /compute/v2.1/os-snapshots/870c5b19-52ed-4d07-b634-f3dace796bbe => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:27:08.192296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4d7f8cbe-ec79-4bd4-8f15-a9d042196f0d tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc5fe7310>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:08.281480 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:08.296511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-63f979c0-dd88-4f06-86db-03a5acdd86fc tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1272 microversion: 2.1 time: 0.197137 May 26 21:27:08.297792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:08 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:08.594816 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4d7f8cbe-ec79-4bd4-8f15-a9d042196f0d tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f" status: 202 len: 0 microversion: 2.1 time: 0.406006 May 26 21:27:08.596210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 16/36] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:27:08 2022] DELETE /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:27:08.607534 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4198039a-49ff-4673-afd0-60aee5292388 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc68aff70>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:08.743952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4198039a-49ff-4673-afd0-60aee5292388 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f" status: 200 len: 344 microversion: 2.1 time: 0.142524 May 26 21:27:08.744869 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 21/37] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:08 2022] GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:09.314518 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:09.315115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:09.333280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:09.334218 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:09.335236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:09.335982 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:09.512132 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:09.612272 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:09.622096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bd0b778d-1045-43f2-b987-cfcf99e3bb56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1272 microversion: 2.1 time: 0.311310 May 26 21:27:09.631440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 17/38] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:09 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:09.761227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e112f63c-8e5b-41f7-b3f8-cd5319f96b4e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc68b6430>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:09.839820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-e112f63c-8e5b-41f7-b3f8-cd5319f96b4e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] HTTP exception thrown: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e112f63c-8e5b-41f7-b3f8-cd5319f96b4e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Request method failure captured: May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f HTTP/1.1 May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_CcU_ai99tpy-DtKQPNvJGdayq8jkLn-YwWQMMBe7uEvqCH15NiUcknzsTFkGGVgeU5r_IHEr9jnVVEruK0lTM6ZpafkcWrg5Bp2nE1LI8yc3_x91qEUWg7Vdv5PW_i1LGZ6wcwYa_hUlx8rtIehOWrU3QQLlKUTvtI0vkv6hplAXo May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:27:09.845910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}] May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 5c66120fd1124221b4a5552ddb6cd145 May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '4f021d19-f08f-46d7-9006-2e0fab1e793f'} May 26 21:27:09.847768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. (HTTP 404) (Request-ID: req-7dfda6e1-f6e0-4e08-9f48-08e6326daa1e) May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:09.848409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:09.849279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:27:09.851947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e112f63c-8e5b-41f7-b3f8-cd5319f96b4e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Returning 404 to user: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e112f63c-8e5b-41f7-b3f8-cd5319f96b4e tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f" status: 404 len: 109 microversion: 2.1 time: 0.096478 May 26 21:27:09.854222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 22/39] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:09 2022] GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:27:09.866450 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b00f4a37-6e96-430b-b266-6f8e3fd3cd2f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc60774c0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:09.938906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-b00f4a37-6e96-430b-b266-6f8e3fd3cd2f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] HTTP exception thrown: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b00f4a37-6e96-430b-b266-6f8e3fd3cd2f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Request method failure captured: May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f HTTP/1.1 May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_CcU_ai99tpy-DtKQPNvJGdayq8jkLn-YwWQMMBe7uEvqCH15NiUcknzsTFkGGVgeU5r_IHEr9jnVVEruK0lTM6ZpafkcWrg5Bp2nE1LI8yc3_x91qEUWg7Vdv5PW_i1LGZ6wcwYa_hUlx8rtIehOWrU3QQLlKUTvtI0vkv6hplAXo May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:27:09.939061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}] May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 5c66120fd1124221b4a5552ddb6cd145 May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '4f021d19-f08f-46d7-9006-2e0fab1e793f'} May 26 21:27:09.940245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. (HTTP 404) (Request-ID: req-89bc64ef-15e8-4054-894b-3f5cb3d98292) May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:09.940910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:27:09.941869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 21:27:09.944313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:09.946305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:27:09.955200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b00f4a37-6e96-430b-b266-6f8e3fd3cd2f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Returning 404 to user: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:27:09.957691 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b00f4a37-6e96-430b-b266-6f8e3fd3cd2f tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f" status: 404 len: 109 microversion: 2.1 time: 0.097677 May 26 21:27:09.962454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 18/40] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:27:09 2022] DELETE /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:27:09.971630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0da64faa-d9d1-4c23-8de4-8001e5f5a5b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Calling method '.version_select at 0x7f7bc715cb80>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:10.036324 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-0da64faa-d9d1-4c23-8de4-8001e5f5a5b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] HTTP exception thrown: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0da64faa-d9d1-4c23-8de4-8001e5f5a5b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Request method failure captured: May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f HTTP/1.1 May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_CcU_ai99tpy-DtKQPNvJGdayq8jkLn-YwWQMMBe7uEvqCH15NiUcknzsTFkGGVgeU5r_IHEr9jnVVEruK0lTM6ZpafkcWrg5Bp2nE1LI8yc3_x91qEUWg7Vdv5PW_i1LGZ6wcwYa_hUlx8rtIehOWrU3QQLlKUTvtI0vkv6hplAXo May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:27:10.039533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c67e60a5274e179ffd719af7cc9457"}]}] May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: a3c67e60a5274e179ffd719af7cc9457 May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787138366 May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 5c66120fd1124221b4a5552ddb6cd145 May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787138366-project May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '4f021d19-f08f-46d7-9006-2e0fab1e793f'} May 26 21:27:10.041736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. (HTTP 404) (Request-ID: req-21e51da1-51a5-4478-8252-8f5cc22075c1) May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:10.042372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:27:10.043273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:27:10.044979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. May 26 21:27:10.046659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:27:10.057972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0da64faa-d9d1-4c23-8de4-8001e5f5a5b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] Returning 404 to user: Volume 4f021d19-f08f-46d7-9006-2e0fab1e793f could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:27:10.058825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0da64faa-d9d1-4c23-8de4-8001e5f5a5b7 tempest-VolumesSnapshotsTestJSON-1787138366 tempest-VolumesSnapshotsTestJSON-1787138366-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f" status: 404 len: 109 microversion: 2.1 time: 0.093048 May 26 21:27:10.059412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 23/41] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:09 2022] GET /compute/v2.1/os-volumes/4f021d19-f08f-46d7-9006-2e0fab1e793f => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:27:10.648769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:10.651231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:10.668962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:10.669420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:10.670202 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:10.680749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:10.838835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:10.847456 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-49469a4c-5a97-48c2-8508-0dc9156089aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1272 microversion: 2.1 time: 0.203256 May 26 21:27:10.856807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 19/42] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:10 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:11.874800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:11.875539 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:11.893240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:11.893830 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:11.894818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:11.897822 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:13.669748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:13.684021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-79cb155a-abdd-40b8-9d28-fa28f63bb1b9 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 1.811649 May 26 21:27:13.684887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 24/43] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:11 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:14.468413 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=10 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:14.701810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:14.712702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:14.727500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:14.729421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:14.735279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:14.737756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:15.205916 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-27b2940c-11f6-4c0e-b49a-933ca8152110 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: .version_select at 0x7f7bc6077ca0>, body: {"keypair": {"name": "tempest-keypair-1921783376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWgw3ZP9jacl2uOG+uxiU/Ofqv0Yeb6PrSZqPACsfrovMtr8++kklRyZkMtPNma1uVtq1GaVKNp/aEy8+4Njq4Mo1+0XxVoFvxX3I9Zavbk6KsV7ljwnR/fqrBcB5gEw=="}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:15.285259 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-27b2940c-11f6-4c0e-b49a-933ca8152110 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:27:15.301873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-27b2940c-11f6-4c0e-b49a-933ca8152110 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:27:15.490580 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-27b2940c-11f6-4c0e-b49a-933ca8152110 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.026364 May 26 21:27:15.490580 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 20/44] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:27:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:15.510779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-690377234", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea9ef1f2-5514-49f0-be2f-c0970bb75a74"}], "security_groups": [{"name": "tempest-securitygroup--864325769"}], "key_name": "tempest-keypair-1027092613", "user_data": "}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:15.608705 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:15.646500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a1afcbd2-19db-4fcc-8589-a791d5692acb tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.948718 May 26 21:27:15.660313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 25/45] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:14 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:16.008247 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] validate_networks() for [('ea9ef1f2-5514-49f0-be2f-c0970bb75a74', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:27:16.640953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:17.149638 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-194213751", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:17.326102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] validate_networks() for [('a60ae016-a71c-495a-9bbe-63d3beeeb1fa', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:27:17.982215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:27:17.983262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:27:17.983928 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:27:17.984556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:27:17.985139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:27:18.000261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:18.003805 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:18.005514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:18.007357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:18.060341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for project c5f69588fe354d20b58594919deb4110. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:27:18.075869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for user 9b94748ea78342629281f2360a54bee4 and project c5f69588fe354d20b58594919deb4110. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:27:18.101844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:27:18.104289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:27:18.275362 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-97ae744e-0fae-4632-93f5-05bf445c5fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.789157 May 26 21:27:18.277099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 21/46] 10.222.0.42 () {62 vars in 1187 bytes} [Thu May 26 21:27:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 21:27:18.284047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:18.285521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:18.293091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:18.294052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:18.295115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:18.295846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:18.714425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:18.728504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c70802f0-d28b-47cd-82db-7269a8efca2b tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.447327 May 26 21:27:18.749732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 22/47] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:18 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:18.760189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6c7e774d-fe0e-465c-99a7-6b07210b91a3 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc5ffc1f0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:18.880316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6c7e774d-fe0e-465c-99a7-6b07210b91a3 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7bdbb0ac-bc0e-4144-807f-dba8fefef903" status: 200 len: 351 microversion: 2.1 time: 0.128351 May 26 21:27:18.880903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:18 2022] GET /compute/v2.1/os-volumes/7bdbb0ac-bc0e-4144-807f-dba8fefef903 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:18.887888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-de3e2883-0d34-472e-8d46-4c961e101ce0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:18.890769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-de3e2883-0d34-472e-8d46-4c961e101ce0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:19.296821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-de3e2883-0d34-472e-8d46-4c961e101ce0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:19.342096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-de3e2883-0d34-472e-8d46-4c961e101ce0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:19.349563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-de3e2883-0d34-472e-8d46-4c961e101ce0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:19.355719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-de3e2883-0d34-472e-8d46-4c961e101ce0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1281 microversion: 2.20 time: 0.472400 May 26 21:27:19.380968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:18 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1281 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:19.764426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:19.765055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:19.808627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:19.814511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:19.815385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:19.820214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:20.749740 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:20.760801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-382ab38f-85ee-469f-bc91-c823fed2ebaa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 1.002062 May 26 21:27:20.773481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:19 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:20.786469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-33334191-b4b9-4fd2-9b66-96afd102c9f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:20.791456 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-33334191-b4b9-4fd2-9b66-96afd102c9f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:21.087400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33334191-b4b9-4fd2-9b66-96afd102c9f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:21.117777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33334191-b4b9-4fd2-9b66-96afd102c9f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:21.136997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33334191-b4b9-4fd2-9b66-96afd102c9f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:21.139675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-33334191-b4b9-4fd2-9b66-96afd102c9f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1281 microversion: 2.20 time: 0.363482 May 26 21:27:21.141485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:20 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1281 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:21.408443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-3a001a5d-fd49-4d26-94d3-0f5d4f406f31 req-294010d9-a00a-4b46-b832-40c7e69d2ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c158d0-52d0-41c6-9ea3-ac90160e5ee0", "tag": "42acb5d5-5de1-46a9-8982-343d8c9cf6ff"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:21.454627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-3a001a5d-fd49-4d26-94d3-0f5d4f406f31 req-294010d9-a00a-4b46-b832-40c7e69d2ae5 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.455367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-3a001a5d-fd49-4d26-94d3-0f5d4f406f31 req-294010d9-a00a-4b46-b832-40c7e69d2ae5 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.480637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-3a001a5d-fd49-4d26-94d3-0f5d4f406f31 req-294010d9-a00a-4b46-b832-40c7e69d2ae5 service nova] Creating event network-changed:42acb5d5-5de1-46a9-8982-343d8c9cf6ff for instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 on hv-cinder-82880 May 26 21:27:21.481483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-3a001a5d-fd49-4d26-94d3-0f5d4f406f31 req-294010d9-a00a-4b46-b832-40c7e69d2ae5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118557) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 21:27:21.484615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.485647 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.492219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.492916 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.504532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.compute.rpcapi [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 21:27:21.505713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118557) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 21:27:21.538249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4b1f6a5e-2072-456b-9c85-a2f539d056a9 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.395319 May 26 21:27:21.539319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 27/52] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:21.683468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:27:21.684620 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:27:21.685468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:27:21.686219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:27:21.686839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:27:21.715240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.716033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.717196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.717947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.746604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for project 318999cb1f874176b2523de9686febc1. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:27:21.751720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for user ee4307a7bdf84fe18efd6ba3dbe50c23 and project 318999cb1f874176b2523de9686febc1. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:27:21.770557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:27:21.774222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:27:21.782340 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:21.789828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:21.799154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.799871 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.811501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.818480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.993233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d93f9dca-e808-412c-916a-2395e71a2b41 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.355610 May 26 21:27:21.999705 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 26/53] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:27:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 5360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:27:22.022932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cee0b934-8170-459b-9574-f47c996b0efc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:22.022932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cee0b934-8170-459b-9574-f47c996b0efc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:22.200831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cee0b934-8170-459b-9574-f47c996b0efc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.213060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cee0b934-8170-459b-9574-f47c996b0efc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1221 microversion: 2.1 time: 0.205739 May 26 21:27:22.238481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 27/54] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:22 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:22.271328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:22.273477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:22.318886 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:22.330629 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:22.343983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:22.343983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:22.513063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.545992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.550563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.552144 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f3e231f6-3db8-4402-b75f-72c08e73abe1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1333 microversion: 2.20 time: 0.301482 May 26 21:27:22.553550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 28/55] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:22 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1333 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:22.567897 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c8f107ff-6127-4f11-950f-150b2da4f0a5 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc68c9f70>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:22.683827 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c8f107ff-6127-4f11-950f-150b2da4f0a5 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/eb4f26aa-bf41-4281-b893-bea820bce2e3" status: 200 len: 350 microversion: 2.1 time: 0.128599 May 26 21:27:22.684691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 29/56] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:22 2022] GET /compute/v2.1/os-volumes/eb4f26aa-bf41-4281-b893-bea820bce2e3 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:22.690164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1269057", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:22.825077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] validate_networks() for [('a60ae016-a71c-495a-9bbe-63d3beeeb1fa', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:27:23.478322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:23.492791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=43 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:23.514185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-16eab137-57db-406c-88d5-93b61c6bee20 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 1.719282 May 26 21:27:23.517896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 28/57] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:21 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:23.571949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:23.572979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:23.584739 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:23.614616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:23.615145 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:23.616066 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:23.616524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.326013 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.339949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.342172 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.343451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-045bfc41-020b-4737-8a80-8a45d7602910 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1339 microversion: 2.20 time: 0.776408 May 26 21:27:24.354782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 29/58] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:23 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1339 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:24.394289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:27:24.394895 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:27:24.395735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:27:24.396198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:27:24.396684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:27:24.409741 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:24.410536 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.412666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:24.413336 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.444378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for project 318999cb1f874176b2523de9686febc1. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:27:24.448962 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for user ee4307a7bdf84fe18efd6ba3dbe50c23 and project 318999cb1f874176b2523de9686febc1. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:27:24.466942 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:27:24.474411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:27:24.601939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:24.601939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:24.601939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:24.601939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.603498 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:24.603498 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.710945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.722238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6bb9e1ce-ccc2-4953-b3d5-2d5bd0852e8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.187310 May 26 21:27:24.723432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:24 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:25.249528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4f011858-178b-4c1f-9a88-36db84bd262f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.562905 May 26 21:27:25.257673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 30/60] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:27:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:27:25.261258 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dd8471ec-030a-4270-8a78-85442ed50816 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:25.261877 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-dd8471ec-030a-4270-8a78-85442ed50816 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:25.362983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:25.364145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:25.366721 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:25.373085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:25.374580 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:25.375452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:25.376211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:25.380243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=41 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:25.418511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-dd8471ec-030a-4270-8a78-85442ed50816 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:25.435614 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dd8471ec-030a-4270-8a78-85442ed50816 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1219 microversion: 2.1 time: 0.171935 May 26 21:27:25.435614 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 31/61] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:25 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:25.510445 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:25.523100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:25.528410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:25.528410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4bbc7d33-fe8e-40e6-b542-60232b810b76 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1339 microversion: 2.20 time: 0.168581 May 26 21:27:25.528410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:25 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:25.604812 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1868804556", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e423d8c6-f848-40d6-99bb-c61a958058f7"}], "security_groups": [{"name": "tempest-securitygroup--129228529"}], "key_name": "tempest-keypair-1921783376", "user_data": "}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:25.740843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:25.742071 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:25.757785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:25.758395 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:25.759475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:25.760045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:25.867858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] validate_networks() for [('e423d8c6-f848-40d6-99bb-c61a958058f7', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:27:25.933408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:25.940894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4762246d-2486-47eb-b337-bfa4328cff21 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.204706 May 26 21:27:25.941451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:25 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:26.446673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:27:26.448505 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:27:26.449073 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:27:26.449559 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:27:26.452096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:27:26.459272 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:26.460156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:26.461574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.462190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.463658 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.464647 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.473661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.475587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.476593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.477551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.501266 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:27:26.506872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:27:26.521550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:27:26.523992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:27:26.603354 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.611569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-630f4a34-8490-409a-886f-fd05584535f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1223 microversion: 2.1 time: 0.158698 May 26 21:27:26.627079 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 33/64] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:26 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1223 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:26.643040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:26.644574 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:26.654464 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.654464 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.656966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.657554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.762300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4c734c4b-91e9-41d0-87cf-0a48f92f1e1a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.154988 May 26 21:27:26.762300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:27:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:27:26.786584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ae2e5a3-4007-4422-9cb4-57bf382d9d9f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:26.787529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5ae2e5a3-4007-4422-9cb4-57bf382d9d9f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:26.866957 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.882507 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.883611 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.884837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-caf2de00-599b-4804-905a-246b53ade977 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.256058 May 26 21:27:26.896115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:26 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:26.917144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5ae2e5a3-4007-4422-9cb4-57bf382d9d9f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.935513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5ae2e5a3-4007-4422-9cb4-57bf382d9d9f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1242 microversion: 2.1 time: 0.167084 May 26 21:27:26.936664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 33/67] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:26 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1242 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:26.958522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:26.959140 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:26.965546 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.965999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.966787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.967247 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.989822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3eb1ab9c-a3c9-46b0-8165-e69aad0514a7 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc5ffcf70>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.058705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3eb1ab9c-a3c9-46b0-8165-e69aad0514a7 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c78d75f1-58fa-48fd-85ed-2a1ffa21bd1b" status: 200 len: 351 microversion: 2.1 time: 0.073381 May 26 21:27:27.059277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 34/68] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:27:26 2022] GET /compute/v2.1/os-volumes/c78d75f1-58fa-48fd-85ed-2a1ffa21bd1b => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:27.086217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-01463be2-bde6-4321-9c39-3c5f6dcc2192 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc5fd7160>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.208788 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-01463be2-bde6-4321-9c39-3c5f6dcc2192 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.126997 May 26 21:27:27.211874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 35/69] 10.222.0.42 () {58 vars in 1133 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:27.212024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:27.222233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ae6f24e0-9856-4d8a-b448-f5386a15f1a1 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc5ff23a0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.226946 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-817f4eaa-80ac-46a8-a7b4-abb17a59bb8c tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.272539 May 26 21:27:27.238606 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 35/70] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:26 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:27.332641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ae6f24e0-9856-4d8a-b448-f5386a15f1a1 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.114505 May 26 21:27:27.333223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 36/71] 10.222.0.42 () {58 vars in 1148 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:27.346569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a6672462-1363-4083-92ec-9d12f0a80951 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc576c820>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.443491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a6672462-1363-4083-92ec-9d12f0a80951 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096674 May 26 21:27:27.443491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 36/72] 10.222.0.42 () {58 vars in 1133 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:27.451957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dd637fb8-53a5-4920-9f0c-4e279cb7ea2b tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc5fd7ee0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.546635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dd637fb8-53a5-4920-9f0c-4e279cb7ea2b tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098382 May 26 21:27:27.546758 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 37/73] 10.222.0.42 () {58 vars in 1166 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:27.564068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ff0fd369-5f16-46f4-aa33-2d62a042f538 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc67d0430>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.633451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.634322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:27.642712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:27.643228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:27.644050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:27.644653 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:27.704790 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ff0fd369-5f16-46f4-aa33-2d62a042f538 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.147856 May 26 21:27:27.712932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 37/74] 10.222.0.42 () {58 vars in 1169 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:27.717903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3be949b9-7bc9-4103-9fe7-fe5a60fd4ce0 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc67d0b80>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.778978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:27.785355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c6aea7eb-176b-4351-a0ef-a3fa520e9c78 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1215 microversion: 2.1 time: 0.156152 May 26 21:27:27.794916 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 38/75] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:27.831760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3be949b9-7bc9-4103-9fe7-fe5a60fd4ce0 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.117002 May 26 21:27:27.835837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 38/76] 10.222.0.42 () {58 vars in 1154 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:27.844335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a99906a1-416b-4da5-a9a0-c652d188015c tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc5fd7310>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.907476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.908353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:27.922930 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:27.927823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:27.929784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:27.929784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.011797 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a99906a1-416b-4da5-a9a0-c652d188015c tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.171463 May 26 21:27:28.012378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 39/77] 10.222.0.42 () {58 vars in 1187 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:28.021262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-757c7356-3d02-48c6-8a1f-ff7e8b36ae1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:28.022116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-757c7356-3d02-48c6-8a1f-ff7e8b36ae1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:28.138998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-757c7356-3d02-48c6-8a1f-ff7e8b36ae1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.150628 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-757c7356-3d02-48c6-8a1f-ff7e8b36ae1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1242 microversion: 2.1 time: 0.136459 May 26 21:27:28.151211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 40/78] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:28 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:28.168291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-871aae36-325f-4649-86d9-a3ac3f7b7a09 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] Calling method '.version_select at 0x7f7bc6077d30>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:28.170461 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.183814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.188591 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.194471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-14693d33-7c43-4e81-93fb-a90b705ff7ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.290588 May 26 21:27:28.195718 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 39/79] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:28.246415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:28.247185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:28.258459 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:28.259249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.260987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:28.261593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.283815 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-871aae36-325f-4649-86d9-a3ac3f7b7a09 tempest-VolumesTestJSON-1418496799 tempest-VolumesTestJSON-1418496799-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.120143 May 26 21:27:28.284686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 41/80] 10.222.0.42 () {58 vars in 1154 bytes} [Thu May 26 21:27:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:28.579774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.593262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-09157abb-5320-4510-ad19-7cc1d733b3ad tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.351724 May 26 21:27:28.605668 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:28 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:28.803420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:28.804976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:28.816806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:28.818245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.819124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:28.819577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.919020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.928403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-02938bf5-d503-4854-8d8f-ef107a1a1dff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1215 microversion: 2.1 time: 0.129776 May 26 21:27:28.930050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 42/82] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:28 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:29.053217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-851732a4-cad9-4a42-a244-4fea85ea1f91 req-346a9ba4-af8f-46ec-8a38-abf40e542d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:29.065376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-851732a4-cad9-4a42-a244-4fea85ea1f91 req-346a9ba4-af8f-46ec-8a38-abf40e542d67 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.065825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-851732a4-cad9-4a42-a244-4fea85ea1f91 req-346a9ba4-af8f-46ec-8a38-abf40e542d67 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.085998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-851732a4-cad9-4a42-a244-4fea85ea1f91 req-346a9ba4-af8f-46ec-8a38-abf40e542d67 service nova] Creating event network-changed:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:27:29.086536 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-851732a4-cad9-4a42-a244-4fea85ea1f91 req-346a9ba4-af8f-46ec-8a38-abf40e542d67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 21:27:29.087638 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.088259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.089189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.089766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.099986 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.compute.rpcapi [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 21:27:29.100974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=118558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 21:27:29.115719 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5d1054f6-47d2-408c-be71-794b542080d1 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227102 May 26 21:27:29.116655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 41/83] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:29.168985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:29.169589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:29.176784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.179441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.179441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.179441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.212993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:29.213954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:29.226194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.226818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.228003 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.228615 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.255046 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.266076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b6095a0f-4b18-448b-839d-bc26bcc74248 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1246 microversion: 2.1 time: 0.100867 May 26 21:27:29.268962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:29 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:29.388844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.399855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.401596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.405703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-33d0590f-2e02-48a5-bd91-c2d5278e2e3b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.194044 May 26 21:27:29.405703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 42/85] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:29 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:29.612437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:29.614280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:29.622018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.624316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.625861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.626618 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.924186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.946870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1aa252f5-4c32-434d-8b8f-d9016aa663f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.328596 May 26 21:27:29.946870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 44/86] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:29 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:29.952682 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:29.953442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:29.963352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.965709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.967487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.967974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.290767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:30.291458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:30.314709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.316009 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.323217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.327508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.471031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:30.481214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-78847cd0-add5-439f-9f57-bf544f2a03c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1271 microversion: 2.1 time: 0.538153 May 26 21:27:30.493513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:29 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1271 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:30.499257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:30.500317 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:30.511698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.512712 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.515209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.516446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.573098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:30.588977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3c83bda1-f6c2-4972-b284-a011050091f1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1294 microversion: 2.1 time: 0.302782 May 26 21:27:30.591413 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 45/88] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:30 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1294 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:30.850768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:30.863797 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:30.866334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:30.867792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7884acc1-0772-4654-9dea-98fd39471d8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.372829 May 26 21:27:30.868591 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 44/89] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:30 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:30.960155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:30.963200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:30.982796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.986019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.986019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.987133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.500475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:31.501203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:31.513702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:31.514196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.516017 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:31.516475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.666443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:31.684801 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6c4bf917-ed3f-468e-ae4a-70d5f0231fbd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1277 microversion: 2.1 time: 0.190011 May 26 21:27:31.686077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 45/90] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:31 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:31.691454 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:31.692961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:31.700320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:31.700931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.702525 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:31.702955 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.763193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:31.772764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c106c80c-3d6e-4018-8c40-d6afcc145724 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.820297 May 26 21:27:31.784631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 46/91] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:30 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:31.837486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:31.849929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-39333136-805a-49a0-9910-89e7ed0ab23e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1300 microversion: 2.1 time: 0.161454 May 26 21:27:31.861039 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 46/92] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:31 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:31.887031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:31.887660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:31.897612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:31.898071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.900892 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:31.901434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.368624 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:32.390736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:32.393736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:32.395286 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e85a138c-3d4e-4fcb-ba68-d26bd9d9f18f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.513495 May 26 21:27:32.404955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 47/93] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:31 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:32.702607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:32.704651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:32.711767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.712209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.713455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.713455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.791241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:32.792168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:32.809291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.809813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.810677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.811086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.025925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.036913 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a508f24d-39fd-43eb-a8f0-cdbeaf867907 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.338228 May 26 21:27:33.049166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:32 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:33.056222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:33.056870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.057639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:33.064837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9292e7bf-c70e-4296-aa1a-fe146d4a1276 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.277666 May 26 21:27:33.074246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:33.074246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.074246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:33.074246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.074835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 48/95] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:32 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:33.427683 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:33.429515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:33.438750 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:33.439060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.440035 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:33.441167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.530620 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.540202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2ada67b5-3692-47ad-949d-0caef1c809ab tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.488758 May 26 21:27:33.541119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 48/96] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:33 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:33.593672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.603079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.604649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.605761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-363136f7-daed-4e3d-a5a4-955f8b2c1abd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.184862 May 26 21:27:33.606318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 49/97] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:33 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:34.056164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:34.057787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:34.064968 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.066095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.066867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.067339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.082639 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:34.083912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:34.100511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.101469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.102554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.103234 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.229775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.241963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1347968c-c85e-437e-9c5a-b9a29d804480 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.190856 May 26 21:27:34.242631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 49/98] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:34 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:34.366903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.376393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8057b616-63ea-4a67-aa67-1385126306d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.298320 May 26 21:27:34.376988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:34 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:34.567736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:34.568961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:34.575908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=14 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:34.578276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.579135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.580322 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.581767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.644968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-80c1859c-f35e-415d-83d8-442916381ab6 req-4cab1212-3205-4581-a714-5b3fdce67166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c158d0-52d0-41c6-9ea3-ac90160e5ee0", "name": "network-vif-plugged", "status": "completed", "tag": "42acb5d5-5de1-46a9-8982-343d8c9cf6ff"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:34.653662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-80c1859c-f35e-415d-83d8-442916381ab6 req-4cab1212-3205-4581-a714-5b3fdce67166 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.654101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-80c1859c-f35e-415d-83d8-442916381ab6 req-4cab1212-3205-4581-a714-5b3fdce67166 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.667558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-80c1859c-f35e-415d-83d8-442916381ab6 req-4cab1212-3205-4581-a714-5b3fdce67166 service nova] Creating event network-vif-plugged:42acb5d5-5de1-46a9-8982-343d8c9cf6ff for instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 on hv-cinder-82880 May 26 21:27:34.673346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-80c1859c-f35e-415d-83d8-442916381ab6 req-4cab1212-3205-4581-a714-5b3fdce67166 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110992 May 26 21:27:34.674477 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 51/100] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:34.680808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:34.682127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:34.691976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.692509 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.693457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.694327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.838829 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.848237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3b63c53a-5aea-4a0a-86ad-2c342c7e4045 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.294171 May 26 21:27:34.848811 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:34 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:34.906165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.914987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.916643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.917861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-21a66409-1b3d-4d9b-a209-8025613689ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.242147 May 26 21:27:34.918519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 52/102] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:34 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:35.259627 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:35.260302 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:35.266553 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.267001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.267890 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.268359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.271042 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:35.393639 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:35.394162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:35.399588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:35.400872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.401321 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.402272 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.402897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.407169 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7d531459-43ac-4054-85e4-57f4d41c7bda tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.151894 May 26 21:27:35.409211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 51/103] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:35 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:35.551782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:35.560452 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3abbe3d1-0cc6-4263-99be-36825e082550 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.170703 May 26 21:27:35.561207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 53/104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:35 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:35.865326 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:35.865933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:35.872896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.873522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.874488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.875098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.935898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:35.936504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:35.942708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.943153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.943946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.944376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.033407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.043296 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3ba5892b-f742-42b5-8aa5-a85c37721fed tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.182836 May 26 21:27:36.043907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 52/105] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:35 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:36.109241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.122402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.123719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a940bf35-5156-4a43-ba93-1b2e860c5848 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.191884 May 26 21:27:36.134644 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 54/106] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:35 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:36.424275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:36.424835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:36.431498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:36.432010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.432792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:36.433236 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.577228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:36.577839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:36.579867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=6 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:36.584818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.592601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:36.593773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.593870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:36.594239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.598133 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9000ded5-d550-46d3-af96-4bd0acc257d2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.177707 May 26 21:27:36.600282 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:36 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:36.727960 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.730119 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:36.735901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d4c5310f-cbb2-4e1c-a994-1094868383ff tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.162518 May 26 21:27:36.741957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:36 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:37.060136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:37.060746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:37.067430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.067901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.068670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.069104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.142943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:37.143702 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:37.151093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.151509 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.152317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.152753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.212153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:37.220519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dcfb3003-f2ce-4f4f-bb1d-503377e62258 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.164220 May 26 21:27:37.221945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 54/109] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:37 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:37.298627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:37.307449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:37.309065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:37.310177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-604d247e-aa36-46dc-8954-30a3857308bf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.171800 May 26 21:27:37.310764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 56/110] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:37 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:37.617654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:37.618976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:37.625704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.626401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.627399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.628354 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.754170 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:37.755716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:37.763253 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.764034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.764858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.765274 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:37.775607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:37.784854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3454b6ec-0b75-4f04-8509-7218be55c4b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.171273 May 26 21:27:37.785980 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 55/111] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:37 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:37.919551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:37.927408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9bfa9f10-e9a5-4e16-b5f8-5f61c0bfa1aa tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.178869 May 26 21:27:37.928029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:37 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:38.240466 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:38.241792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:38.251309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.252002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.253686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.254280 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.327028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:38.327645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:38.329533 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=26 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:38.336564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.337480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.338684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.339333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.603726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.617128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.620444 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.624403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a2d14630-3442-4198-a3bd-9182ff4fadf9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.301158 May 26 21:27:38.626280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 58/113] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:38 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:38.803041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:38.803864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:38.804765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.816864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.818073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f3c508c9-afe5-4b1f-9d15-0c3de0c726bb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.582153 May 26 21:27:38.820295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 56/114] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:38 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:38.824657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.826933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.828965 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.950136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:38.953746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:38.972668 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.972668 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.972668 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.976932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.050406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.059730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-50032096-f07d-478c-b7b4-804bc726191d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.262415 May 26 21:27:39.060981 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 59/115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:38 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:39.097170 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:39.318411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.326704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c00bf22d-9514-4396-b93c-de468b16b8c5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.385422 May 26 21:27:39.327288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 57/116] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:38 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:39.652136 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:39.653224 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:39.683325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:39.684004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.684908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:39.685357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.839779 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:39.840418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:39.848466 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:39.848914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.850258 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:39.850702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.899390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.910150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.911874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.913028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b3939134-62fc-4c28-a5ec-980521066693 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.269625 May 26 21:27:39.915120 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 60/117] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:39 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:40.078521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:40.079363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:40.086948 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.087476 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.088918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.090117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.210255 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:40.220684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e1ea8bc8-055d-4e46-99d4-892dd2cc1e49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.384353 May 26 21:27:40.230718 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 58/118] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:39 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:40.296526 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:40.305346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1494b4b4-6092-4814-a135-2f5b131752ed tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.230708 May 26 21:27:40.306095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 61/119] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:40 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:40.344373 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:40.344993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:40.358088 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.358551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.359646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.360240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.602419 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-ce24e537-26d4-4e10-be71-f0a116072c81 req-783221d6-f2ae-42c9-8cb1-9dd1ea584b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bec145-b7bb-413b-a4ee-124c14212c63", "tag": "2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:40.640338 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-ce24e537-26d4-4e10-be71-f0a116072c81 req-783221d6-f2ae-42c9-8cb1-9dd1ea584b30 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.641002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-ce24e537-26d4-4e10-be71-f0a116072c81 req-783221d6-f2ae-42c9-8cb1-9dd1ea584b30 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.670369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-ce24e537-26d4-4e10-be71-f0a116072c81 req-783221d6-f2ae-42c9-8cb1-9dd1ea584b30 service nova] Creating event network-changed:2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e for instance 94bec145-b7bb-413b-a4ee-124c14212c63 on hv-cinder-82880 May 26 21:27:40.676717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-ce24e537-26d4-4e10-be71-f0a116072c81 req-783221d6-f2ae-42c9-8cb1-9dd1ea584b30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077789 May 26 21:27:40.677699 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 62/120] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:40.754844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:40.774077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-09eed7af-ffa2-49f6-8669-c8033afc1c83 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.433991 May 26 21:27:40.784532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 59/121] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:40 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:40.934244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:40.935237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:40.943635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.943635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.944401 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.945022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.116743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.125648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.127309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.128335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8a04b214-53d7-4ca0-a1f3-124e5590a1ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.199746 May 26 21:27:41.128890 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 63/122] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:40 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:41.238334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:41.238862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:41.244999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.245447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.246237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.246663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.322442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:41.323056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:41.330495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.331698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.332497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.333031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.421967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.433049 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-30befb42-f2d5-4ba0-86b9-2b728bd74674 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.199522 May 26 21:27:41.433780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 60/123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:41 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:41.533165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.541469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9ef1cd8a-09e1-4f81-ba36-d487f5729f0a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.222855 May 26 21:27:41.542094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 64/124] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:41 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:41.793394 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:41.794191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:41.801649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.804399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.804399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.804399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.965854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.973797 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a68aa496-1867-4fc0-aec6-f10a6d707875 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.185088 May 26 21:27:41.974532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 61/125] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:41 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:42.152765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:42.153525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:42.159693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.160177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.160936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.161395 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.333402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.341781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.343207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.344320 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-df1e1fef-8e9f-4be7-9f16-689a4ff6805c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.195496 May 26 21:27:42.344902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 65/126] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:42 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:42.451310 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:42.456790 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:42.460899 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.461422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.462203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.462644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.567203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:42.567203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:42.569440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.570205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.571200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.571576 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.624701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.633572 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c827d31e-b0bd-41d9-8b7a-0b9894437a79 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.187058 May 26 21:27:42.634135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 62/127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:42 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:42.704328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-134beea4-5027-455c-8492-8c6d65dfafc9 req-7306a965-14da-4434-aa5b-85fd876f95cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9", "tag": "b2321d87-7db4-4cc6-a9c8-6caeb967992e"}, {"name": "network-changed", "server_uuid": "d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1", "tag": "24cfeb63-c26b-4bcf-af3c-b3af9fdb259d"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:42.707414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.715245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-be4f9552-55c9-4d05-a5f2-5e5fddf9da34 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.160330 May 26 21:27:42.715414 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-134beea4-5027-455c-8492-8c6d65dfafc9 req-7306a965-14da-4434-aa5b-85fd876f95cb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.715911 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:42 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:42.716030 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-134beea4-5027-455c-8492-8c6d65dfafc9 req-7306a965-14da-4434-aa5b-85fd876f95cb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.729525 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-134beea4-5027-455c-8492-8c6d65dfafc9 req-7306a965-14da-4434-aa5b-85fd876f95cb service nova] Creating event network-changed:b2321d87-7db4-4cc6-a9c8-6caeb967992e for instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 on hv-cinder-82880 May 26 21:27:42.730055 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-134beea4-5027-455c-8492-8c6d65dfafc9 req-7306a965-14da-4434-aa5b-85fd876f95cb service nova] Creating event network-changed:24cfeb63-c26b-4bcf-af3c-b3af9fdb259d for instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 on hv-cinder-82880 May 26 21:27:42.736548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-134beea4-5027-455c-8492-8c6d65dfafc9 req-7306a965-14da-4434-aa5b-85fd876f95cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036983 May 26 21:27:42.737716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 63/129] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:42.996401 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:42.997273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:43.003377 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.003851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.004692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.005120 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.138668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:43.146717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-afb6d6f0-6805-4085-910c-8c27fe6bb8cf tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.154131 May 26 21:27:43.147310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 67/130] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:42 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:43.364390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:43.365141 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:43.372562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.373019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.373803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.374238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.520972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:43.529149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:43.530720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:43.531853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3511c930-e683-4469-84d5-37913da1bb1a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.172598 May 26 21:27:43.532415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 64/131] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:43 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:43.650108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:43.651325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:43.658469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.659026 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.659920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.660561 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.733079 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:43.734209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:43.743183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.743695 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.744666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.745343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.804644 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:43.812386 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-905a8fb2-1e57-4ba9-9534-9d2375c897c7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.166059 May 26 21:27:43.813016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:43 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:43.887451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:43.894885 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f2c9bee2-d58a-4ef2-b9a9-5decc62dc852 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.165990 May 26 21:27:43.895504 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 65/133] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:43 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:44.163490 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:44.164135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:44.170187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.170640 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.171408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.171862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.304082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.311541 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0eb8914a-ec78-42ee-b91f-7d6fa6679019 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1314 microversion: 2.1 time: 0.151896 May 26 21:27:44.312155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:44 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:44.549893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:44.550494 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:44.557396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.557840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.558604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.559036 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.715861 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.727654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.729907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.731599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ac4e1379-530f-4925-8ba6-5a7fbfb576b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.185480 May 26 21:27:44.732838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 66/135] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:44 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:44.832458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:44.833986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:44.841851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.842301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.843095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.843527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.911068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:44.911678 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:44.918119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.918551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.919298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:44.919734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.984418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.993164 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-22217bc1-3a28-465c-9ec0-5c5c4c62b81f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.166323 May 26 21:27:44.993964 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 70/136] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:44 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:45.069804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:45.078297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-55739ac8-5d6e-4aaa-af6b-d41d5fd372c3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.171125 May 26 21:27:45.078905 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 67/137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:44 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:45.328831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:45.329768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:45.336025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:45.336485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:45.337256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:45.337724 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:45.474662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:45.482088 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a8b202e7-a3ac-44ae-8163-d41454d801d5 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1500 microversion: 2.1 time: 0.157197 May 26 21:27:45.482675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 71/138] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:45 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:45.750399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:45.751019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:45.758364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:45.758812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:45.759594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:45.760261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:45.780266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:46.012111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:46.012729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:46.019347 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.019823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.020600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.021041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.184411 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.192795 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d569351b-3ee3-4568-ae14-e82bce3161b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.184495 May 26 21:27:46.193595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 72/139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:46 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:46.199410 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:46.200342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:46.208862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.209409 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.210580 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.211077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.215591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:46.265881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.282730 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.284622 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.285729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a3a19d21-f83c-4a1c-a6cd-71fe31e539d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.539805 May 26 21:27:46.286294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 68/140] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:45 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:46.373332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.384061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0923bcce-ec0f-4c19-a362-befe057abd8e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.189069 May 26 21:27:46.387862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 73/141] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:46 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:46.856369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-7b2af10a-ed99-42bb-93e8-2c8076c455bc req-0ca2cb52-d75a-43fe-8ced-207bc981c60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "name": "network-vif-plugged", "status": "completed", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:46.866500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-7b2af10a-ed99-42bb-93e8-2c8076c455bc req-0ca2cb52-d75a-43fe-8ced-207bc981c60c service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.866951 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-7b2af10a-ed99-42bb-93e8-2c8076c455bc req-0ca2cb52-d75a-43fe-8ced-207bc981c60c service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.888349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-7b2af10a-ed99-42bb-93e8-2c8076c455bc req-0ca2cb52-d75a-43fe-8ced-207bc981c60c service nova] Creating event network-vif-plugged:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:27:46.888349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-7b2af10a-ed99-42bb-93e8-2c8076c455bc req-0ca2cb52-d75a-43fe-8ced-207bc981c60c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 May 26 21:27:46.888349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 69/142] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:47.214598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:47.215268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:47.217287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:47.222824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.223275 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.224106 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.224528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.305680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:47.307404 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:47.315137 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.316445 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.317283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.317720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.382924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.391306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-08a4a362-ef0c-48ce-85be-0d90e860ded1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.180622 May 26 21:27:47.392018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 74/143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:47 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:47.406544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:47.407284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:47.413920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.416696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.416696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.416696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.477802 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.487363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.488974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.490163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7531a34c-cdc4-44ed-a010-8f324646ebbe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.190247 May 26 21:27:47.492859 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 70/144] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:47 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:47.559999 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.568492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0c65dd93-9f37-4927-b810-c558cb16e4fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.166106 May 26 21:27:47.569080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 75/145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:47 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:47.993884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a122efa2-6345-40c6-b4e6-167c3b5bfb6e"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:47.994946 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:48.001829 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.002285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.003650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.004107 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.409271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:48.409871 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:48.417112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.417549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.418298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.418727 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.551445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.559661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c06e095e-c545-471b-a3d0-5bae4f1d650f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.154718 May 26 21:27:48.560461 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 76/146] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:48 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:48.565199 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:48.565799 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:48.571950 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.572403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.573178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.573611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.701268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.710025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.711615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.712750 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a05d09b2-0654-46c6-a37c-434f0ddc1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.151361 May 26 21:27:48.713308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 77/147] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:48 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:48.717697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:48.718302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:48.725155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.725619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.726391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.726825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.860923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.868517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c3e337a9-d1b4-43ea-9a7f-82aebd0f19fc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.154221 May 26 21:27:48.869087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 78/148] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:48 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:49.576651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:49.577280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:49.584742 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.584742 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.585263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.585779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.721783 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:49.730609 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9aac9ec2-5253-4696-baff-c7f82bd186bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.157788 May 26 21:27:49.731168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 79/149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:49 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:49.736053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:49.737144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:49.742748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.743186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.743960 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.744393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.872117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:49.881498 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:49.883363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:49.884521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-db2b12dd-ba43-47f8-9699-3726f9540394 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.152150 May 26 21:27:49.885078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 80/150] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:49 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:49.890364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:49.890968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:49.897530 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.897969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.898728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.899156 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:50.047824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:50.056303 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2c4d3cae-f93d-4758-8b8d-4e0cf205b3f8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.170088 May 26 21:27:50.056884 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 81/151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:49 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:50.747271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:50.747920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:50.754387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:50.754825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:50.755571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:50.756030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:50.880316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:50.887625 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d8d0ee6d-7999-414b-b46e-13c51f1d497a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.144286 May 26 21:27:50.888237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 82/152] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:50 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:50.901648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:50.902240 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:50.908012 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:50.908443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:50.909194 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:50.909668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:51.228430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.236847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.239082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.240094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8830892d-c9e2-4a23-87f4-c1a8b0f520f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.342072 May 26 21:27:51.240657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 83/153] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:50 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:51.245198 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:51.245807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:51.251840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:51.252323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:51.253107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:51.254107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:51.384059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.391507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3932d65d-aa23-4df7-9d2f-a8d24c6896c6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.149894 May 26 21:27:51.392114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 84/154] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:51 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:51.905075 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:51.905692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:51.912303 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:51.912752 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:51.913501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:51.913933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.041515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.048988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c4250341-9da3-4a96-89fd-22e4c78d0d6e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.147905 May 26 21:27:52.049560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 85/155] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:51 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:52.262404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:52.263578 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:52.270851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:52.271317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.272095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:52.272693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.409596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.417903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.419460 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.420593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-edb7a7db-bd82-4ac3-895d-c9c13cb0bbae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.165577 May 26 21:27:52.421148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 86/156] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:52 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:52.426488 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:52.427088 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:52.433489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:52.433935 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.434703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:52.437717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.562794 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.570973 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dfb84945-c1e0-455a-a4f2-7fe372ad761c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.148886 May 26 21:27:52.571535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 87/157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:52 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:53.065801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:53.066450 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:53.072427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.072880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.073642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.074087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.207768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.215193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6b45f4f5-a0db-415e-be30-69840ff898fd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.153423 May 26 21:27:53.215838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 88/158] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:53 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:53.438746 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:53.439524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:53.445863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.446339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.447114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.447545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.586325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.588675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:53.595518 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.597729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.598991 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8b189bfa-c41c-4e81-82e9-6e3a1af63ae9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.164437 May 26 21:27:53.599563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 89/159] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:53 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:53.604277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:53.604928 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:53.611018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.611469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.612265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.612730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.767915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.788743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-13db24c5-3e57-478b-83b4-33c098a25817 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.178774 May 26 21:27:53.788743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 90/160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:53 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:54.232847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:54.233473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:54.240029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.240470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.241223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.241650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.365858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.373108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4d0cf2a3-3fa2-431d-822f-11dc4c7b960b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.144101 May 26 21:27:54.373674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 91/161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:54 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:54.617903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:54.618503 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:54.624794 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.625237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.626007 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.626563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.789836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.789836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.790104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.790104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-18e35a46-50b7-46da-acf7-3414d9fb2312 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.163289 May 26 21:27:54.790104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 92/162] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:54 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:54.798221 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:54.798825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:54.805261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.805709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.806467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.806895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.937599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.944988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-18b4b27b-4d30-4b71-9db5-dfd0933876df tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.152854 May 26 21:27:54.945546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 93/163] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:54 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:55.389681 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:55.390285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:55.396905 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.397347 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.398106 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.403326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.594403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.594403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9c3a6b9c-a0e1-4f1b-bfa4-4ab738fdeb2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.154106 May 26 21:27:55.594403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 94/164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:55 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:55.795710 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:55.892059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:55.892059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.892059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.892059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.893371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.945627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.960970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.960970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.960970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b5024e67-72aa-44ac-87ec-41933f94111c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.164903 May 26 21:27:55.961441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 95/165] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:55 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:55.962320 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:55.962923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:55.968951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.987137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.987137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.987137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:56.098287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:56.106042 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f3d36818-9bb0-4703-83d3-3d3166e92dd5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.147339 May 26 21:27:56.106709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 96/166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:55 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:56.603959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:56.604603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:56.610489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:56.610936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:56.611694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:56.612150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:56.740703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:56.748124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1f86575a-0328-4ba5-b692-1d46a5cf0c32 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.148095 May 26 21:27:56.748701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 97/167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:56 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:56.974838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:56.975437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:56.981824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:56.982262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:56.983025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:56.983452 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:57.113360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.122107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.123626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.124766 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-000e0244-36b3-4550-a061-e02ae93aa011 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.154395 May 26 21:27:57.125347 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 98/168] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:56 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:57.129778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:57.130381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:57.136659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:57.137107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:57.137874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:57.138311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:57.265913 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.274090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2de573c0-e0ca-460f-94f9-17b227a78ae7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.147798 May 26 21:27:57.274663 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 99/169] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:57 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:57.764929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:57.765564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:57.772295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:57.772768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:57.773705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:57.774180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:57.914906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.922392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b50f48c6-670b-4fff-a9ba-aa44edaf3322 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.161331 May 26 21:27:57.922952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 100/170] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:57 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:57.999263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=75 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:58.145098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:58.145729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:58.152845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.153313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.154091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.154526 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.156937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=17 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:58.290301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.301629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.305471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.305471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-56b2c803-5393-4f35-9859-6afd3c3fbf66 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.166040 May 26 21:27:58.305471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 101/171] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:58 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:58.309842 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:58.310438 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:58.316829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.317270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.319785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.320318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.465581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.473977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-304ee28c-e912-40d0-adcb-a9299d6c5ce9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.167674 May 26 21:27:58.474561 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 102/172] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:58 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:27:58.941150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:58.941953 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:58.948249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.948698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.949465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.949964 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.086317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.094630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e7756455-2021-437d-ad61-225cf11a3159 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.157942 May 26 21:27:59.095209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 103/173] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:58 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:27:59.322901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:59.323504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:59.329547 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:59.329996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.330756 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:59.331197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.462573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.471167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.474254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.474254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e23516f3-2584-40fc-9711-e1e64423df45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.154809 May 26 21:27:59.474807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 104/174] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:27:59 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:59.491368 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:59.492006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:59.498594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:59.499117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.500061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:59.500489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.634667 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.642123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f2e11fff-399c-43f8-842a-c9ee99cc8a4b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.155151 May 26 21:27:59.642688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 105/175] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:27:59 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:00.111386 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:00.112046 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:00.118120 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.118576 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.119364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.119824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.134626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:00.244804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.252239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-605b99c4-f137-4641-8a50-4116fe365d3d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.144622 May 26 21:28:00.252819 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 106/176] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:00 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:00.491856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:00.492458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:00.498723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.499167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.499966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.500399 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.635070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.643152 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.645303 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.646394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e627c826-6040-480c-a569-f634fd97c78c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.158541 May 26 21:28:00.646977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 107/177] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:00 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:00.658040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:00.658634 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:00.664778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.665227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.665978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.666492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.794558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.802399 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b7cf9d69-8ad1-4079-9288-2aa52d4513a8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.148023 May 26 21:28:00.802956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 108/178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:00 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:01.269265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:01.269924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:01.276218 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.276738 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.277616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.278052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.410064 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.417548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f06b6151-dda9-4473-b132-fc42f8210376 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.152423 May 26 21:28:01.418116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 109/179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:01 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:01.663832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:01.664425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:01.670415 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.670857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.671604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.672058 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.809639 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.816593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.818110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.819212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-12fdcdb7-f99b-439f-90ba-ce9a8f7fffc1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.159998 May 26 21:28:01.819791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 110/180] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:01 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:01.824181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:01.824789 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:01.830828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.831844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.832618 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.833053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.963631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.971270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-71a7fcdc-8ae4-4941-969a-cc8dc9b5a56e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.150495 May 26 21:28:01.971872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 111/181] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:01 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:02.439259 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:02.441591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:02.448945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:02.449826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:02.450997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:02.452090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:02.664166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:02.672027 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-16b81eb6-e84e-48ad-8484-06444e82bbfc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.241237 May 26 21:28:02.672591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 112/182] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:02 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:02.838090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:02.838842 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:02.845407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:02.846102 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:02.847611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:02.848082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.000672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.010785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.012727 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.013974 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e9f685fb-4dc0-4d5e-8c89-780b47ae04bb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.180121 May 26 21:28:03.014545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 113/183] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:02 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:03.019986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:03.020595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:03.027187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:03.027626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.028438 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:03.028872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.143200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c70ee826-8387-4a33-b73e-ecd487202fa4 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "POST /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.152776 May 26 21:28:03.150550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 71/184] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:27:47 2022] POST /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0/os-volume_attachments => generated 194 bytes in 15161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:03.181763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.193638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c1c27ef3-848d-423a-85e3-64bef69cc8d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.177528 May 26 21:28:03.194688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 114/185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:03 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:03.692513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:03.695542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:03.708049 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:03.708814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.710190 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:03.711155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.742432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-eb46845f-b2d2-42a5-8ad1-33b65557d28b req-942f10a5-165f-493a-ada2-08de13e5390a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1", "name": "network-vif-plugged", "status": "completed", "tag": "24cfeb63-c26b-4bcf-af3c-b3af9fdb259d"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:03.752244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-eb46845f-b2d2-42a5-8ad1-33b65557d28b req-942f10a5-165f-493a-ada2-08de13e5390a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:03.753064 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-eb46845f-b2d2-42a5-8ad1-33b65557d28b req-942f10a5-165f-493a-ada2-08de13e5390a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.766455 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-eb46845f-b2d2-42a5-8ad1-33b65557d28b req-942f10a5-165f-493a-ada2-08de13e5390a service nova] Creating event network-vif-plugged:24cfeb63-c26b-4bcf-af3c-b3af9fdb259d for instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 on hv-cinder-82880 May 26 21:28:03.772124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-eb46845f-b2d2-42a5-8ad1-33b65557d28b req-942f10a5-165f-493a-ada2-08de13e5390a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036416 May 26 21:28:03.772858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 115/186] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:03.865285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.874670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2c0f6031-79cf-4f24-b14c-d72e90bd949f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.188161 May 26 21:28:03.875572 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 72/187] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:03 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:04.033130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:04.034232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:04.041471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.041998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.049018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.049018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.210550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.217343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:04.217954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:04.220162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.221904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.223292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-db0407ae-8af2-4540-8f80-b6c0e5dab423 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.194831 May 26 21:28:04.224070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 116/188] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:04 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:04.225005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.225453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.226463 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.226900 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.508705 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.516083 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7346084e-fe65-48b9-b7a7-07c7c3b596d8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.303701 May 26 21:28:04.516644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 73/189] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:04 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:04.905294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:04.906068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:04.913104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.913554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.914330 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.914772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.057840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.071660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-31a6c629-7244-46a5-972a-956954b6cd3a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.179472 May 26 21:28:05.072288 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 117/190] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:04 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:05.241549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:05.242159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:05.248875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:05.249933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.250076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:05.250516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.390469 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.399529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.401062 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.402200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-22dd0be0-8747-4c3b-9d01-604c4661e7f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.164856 May 26 21:28:05.402760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 74/191] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:05 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:05.532629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:05.533267 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:05.540424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:05.540866 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.541631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:05.542062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.813079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.821527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7517edc3-5cef-4bae-9bc2-6a3823486e77 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.292882 May 26 21:28:05.822108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 118/192] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:05 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:06.089095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:06.089800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:06.096296 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.096825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.097647 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.098215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.238593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.245665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3145ad57-1c5d-4893-a902-8b2f6cc6050c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.160418 May 26 21:28:06.246281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 75/193] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:06 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:06.421649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:06.422281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:06.429628 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.430072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.430867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.431362 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.580859 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.589324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.590852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.591993 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-56b4a000-decf-44ae-8927-f1be41490c97 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.174587 May 26 21:28:06.592915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 119/194] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:06 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:06.838462 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:06.839079 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:06.846288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.847416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.848263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.848703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.194021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:07.201881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0e72846f-d44e-46e1-b5bc-ccfd61d52310 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.367334 May 26 21:28:07.202462 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 76/195] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:06 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:07.263229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:07.263798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:07.270985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:07.271431 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.272237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:07.272677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.415720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:07.423758 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4fbfcc7f-1262-4ffc-adc6-f534a0bb1049 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.164557 May 26 21:28:07.424453 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 120/196] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:07 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:07.610831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:07.611597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:07.618765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:07.619423 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.620285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:07.620776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.776270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:07.786832 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:07.788447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:07.789587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-287aad7c-5b3e-425f-88bf-5f36a0af2ce8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.183037 May 26 21:28:07.790152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 77/197] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:07 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:08.220336 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:08.220955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:08.228132 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.228536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.229322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.229759 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.377821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.386292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1f014562-f136-4572-86bd-1467123870ef tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.170067 May 26 21:28:08.386872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 121/198] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:08 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:08.442958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:08.443650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:08.450968 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.451410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.452226 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.452676 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.599893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.611892 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-429a2a08-cf79-48ce-9b3d-fec57bfae638 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.174180 May 26 21:28:08.613366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 78/199] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:08 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:08.808792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:08.809398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:08.816440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.816931 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.817922 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.818404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.963290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.972826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.974637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.975806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2aaf37a0-bbf9-4e43-8357-5679c24205c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.170974 May 26 21:28:08.976376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 122/200] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:08 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:09.403784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:09.404405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:09.411200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:09.411639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:09.412438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:09.412865 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:09.563467 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:09.569330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-752261f7-1dec-4188-9898-747ab2a2bff5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.169538 May 26 21:28:09.569973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 79/201] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:09 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:09.643081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:09.643834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:09.650112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:09.650562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:09.651339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:09.651799 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:09.819393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:09.821778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:09.827673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-89cf98cd-558f-4253-9fb4-92e30e6fcf7a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.188930 May 26 21:28:09.833660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 123/202] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:09 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:09.998594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:09.999869 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:10.011351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.012168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.013548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.014334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.189087 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.204849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.208473 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.210593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a633e6a8-70f6-4b93-9eb3-71bcae049c0b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.219620 May 26 21:28:10.211636 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 80/203] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:09 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:10.586738 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:10.587235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:10.589203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:10.594318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.594756 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.595517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.595995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.740306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.748180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c95fa94a-8c00-432f-b6d5-3b96c87f2667 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.165727 May 26 21:28:10.748765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 124/204] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:10 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:10.849687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:10.850237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:10.856928 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.857368 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.858151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.858644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.004683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.015080 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-aaaf4578-c346-477a-9e1a-cc5806da4080 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.170126 May 26 21:28:11.015877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 81/205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:10 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:11.235317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:11.236189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:11.243122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.243570 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.244402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.244838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.434025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.449277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.451449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.467047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-73c1f1e5-887b-4ffc-9323-ccd6ad52ce81 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.221871 May 26 21:28:11.467047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 125/206] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:11 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:11.766854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:11.767892 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:11.774460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.774919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.775700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.776191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.974952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.982958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-43816fc3-ab34-4610-970e-437815d87f99 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.220792 May 26 21:28:11.983649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 82/207] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:11 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:12.034144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:12.035276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:12.041622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:12.042310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:12.043218 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:12.043529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:12.234521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.250371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-070e54a0-5eab-490b-9852-360bc50139a9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.219714 May 26 21:28:12.264354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 126/208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:12 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:12.474516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:12.475990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:12.490331 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:12.492232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:12.493060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:12.497177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:12.677847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.686511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.692064 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.692064 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c30c1801-7f00-40ab-b386-686a3027cf21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.221463 May 26 21:28:12.692064 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 83/209] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:12 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:13.001907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:13.002615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:13.009349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.009793 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.010571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.011004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.193016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.201678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e421f8c1-c5e6-4582-8b6c-e32103010767 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.203709 May 26 21:28:13.202251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 127/210] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:12 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:13.278606 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:13.279127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:13.286274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.286721 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.287477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.287941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.439488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.448275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f46b15b3-3647-4275-b9d4-0d034597cc57 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.173575 May 26 21:28:13.448889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 84/211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:13 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:13.709325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:13.710483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:13.718424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.718867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.719673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.720134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.785971 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-1d427f2b-576f-4aad-befa-8ace53de0c99 req-4a3eb00d-6cf7-42fd-89c2-9f42806d09ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bec145-b7bb-413b-a4ee-124c14212c63", "name": "network-vif-plugged", "status": "completed", "tag": "2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:13.804671 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-1d427f2b-576f-4aad-befa-8ace53de0c99 req-4a3eb00d-6cf7-42fd-89c2-9f42806d09ac service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.805429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-1d427f2b-576f-4aad-befa-8ace53de0c99 req-4a3eb00d-6cf7-42fd-89c2-9f42806d09ac service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.822411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-1d427f2b-576f-4aad-befa-8ace53de0c99 req-4a3eb00d-6cf7-42fd-89c2-9f42806d09ac service nova] Creating event network-vif-plugged:2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e for instance 94bec145-b7bb-413b-a4ee-124c14212c63 on hv-cinder-82880 May 26 21:28:13.828987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-1d427f2b-576f-4aad-befa-8ace53de0c99 req-4a3eb00d-6cf7-42fd-89c2-9f42806d09ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049978 May 26 21:28:13.828987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 85/212] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:13.894732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.904070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.906011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.907597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-21235c9a-408d-4f7e-a761-f8fb10c17616 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.202882 May 26 21:28:13.908526 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 128/213] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:13 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:14.219000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:14.219692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:14.226051 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.226536 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:14.227290 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.227718 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:14.370012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:14.379417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5aa0fdbb-affe-40c5-b811-ef1842be76d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.164517 May 26 21:28:14.380023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 86/214] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:14 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:14.469074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:14.469686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:14.477088 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.477415 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:14.479893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.480391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:14.646660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:14.655810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f57446cf-82f0-4c10-b584-4514e4e7260a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.190458 May 26 21:28:14.656458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 129/215] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:14 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:14.934121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:14.934707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:14.942465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.943393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:14.944541 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.945174 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:15.097616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.101154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:15.106187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.107896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.108997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f3beb0a4-e03a-453a-85c1-cf6ce49dff17 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.179033 May 26 21:28:15.109551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 87/216] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:14 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:15.397666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:15.398513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:15.404870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:15.405322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:15.406503 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:15.406945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:15.554384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.562460 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6ef9e6eb-8218-45c4-9927-cc701c3f0d02 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.169122 May 26 21:28:15.563882 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 130/217] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:15 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:15.682313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:15.683296 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:15.691067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:15.691774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:15.692748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:15.693287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:15.836707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.845304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-68a16910-3528-44fd-9ff7-dff7d2befbaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.168674 May 26 21:28:15.845304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 88/218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:15 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:16.127418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:16.128060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:16.135024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.135496 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.140291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.140291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.272412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.281712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.283486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.285599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-53174d6b-3334-47e0-bf60-8cad152cc1d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.163124 May 26 21:28:16.292230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 131/219] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:16 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:16.580592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:16.582423 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:16.597981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.597981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.597981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.597981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.737067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.746056 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b2f006f6-4d2c-4df4-a646-32fa600f5d4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.169540 May 26 21:28:16.746597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 89/220] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:16 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:16.862167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:16.863511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:16.870434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.871111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.871918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.872368 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.011011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.019062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-977e6c44-5e22-424f-bd08-6f9710249c1b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.161005 May 26 21:28:17.019625 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 132/221] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:16 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:17.308934 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:17.309543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:17.317005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.317440 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.318218 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.318655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.468753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.484739 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.486810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.488575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-79c2eacd-96ad-467a-9b5d-53a057e6b35f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.183444 May 26 21:28:17.489151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 90/222] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:17 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:17.766214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:17.767270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:17.778041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.778700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.780134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.780945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.931515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.939441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7bc2a3fd-fce8-46c8-8dcf-bc7eb0028990 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.180598 May 26 21:28:17.940824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 133/223] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:17 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:18.043524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:18.044165 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:18.058645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.059281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.060125 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.060565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.227018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.235478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f8def7a5-cb61-44b2-b898-3d88ffbb7fc4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.197150 May 26 21:28:18.236248 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 91/224] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:18 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:18.515286 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:18.516238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:18.522923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.523400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.524331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.524761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.663471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.671936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.673655 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.674781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-92d179fa-36bd-49fd-a5fb-5efb49680313 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1406 microversion: 2.20 time: 0.163734 May 26 21:28:18.675333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 134/225] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:18 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:18.961135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:18.962644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:18.976540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.976991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.978190 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.978338 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.115018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.122674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1f07c122-849b-47bd-bac5-cfd7cb2b61c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.168762 May 26 21:28:19.123435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 92/226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:18 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:19.255187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:19.255809 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:19.266570 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.267345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.270670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.270670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.546464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.555014 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ada9744d-7fc8-4ac7-908e-6a52fc282cd1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.305420 May 26 21:28:19.555581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 135/227] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:19 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:19.693241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:19.693987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:19.700333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.700784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.701555 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.701992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.935909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.943987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.945508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.946656 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-40ad2f2f-272d-453d-b6d3-03369ff7d2ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1599 microversion: 2.20 time: 0.257989 May 26 21:28:19.947283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 93/228] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:28:19 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1599 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:19.964697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:19.965168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:19.971893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.972350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.973637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.974065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.089908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8c2d1bc4-9218-4a13-9e09-cc26dcdbf252 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.129247 May 26 21:28:20.090496 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 136/229] 10.222.0.42 () {60 vars in 1315 bytes} [Thu May 26 21:28:19 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:28:20.140616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:20.141244 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:20.147665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.148142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.148915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.149344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.302145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:20.310720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e28c6f00-1a3f-445b-8a60-fc93356108d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.174715 May 26 21:28:20.311307 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 94/230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:20 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:20.573170 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:20.574472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:20.582109 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.583620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.584768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.585435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.784309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-7cb2fe68-0c5b-4c7b-9eda-b9b44c46e929 req-15b59449-9b22-467a-a71e-918d58814bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9", "name": "network-vif-plugged", "status": "completed", "tag": "b2321d87-7db4-4cc6-a9c8-6caeb967992e"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:20.794382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-7cb2fe68-0c5b-4c7b-9eda-b9b44c46e929 req-15b59449-9b22-467a-a71e-918d58814bf5 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.794906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-7cb2fe68-0c5b-4c7b-9eda-b9b44c46e929 req-15b59449-9b22-467a-a71e-918d58814bf5 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.808569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-7cb2fe68-0c5b-4c7b-9eda-b9b44c46e929 req-15b59449-9b22-467a-a71e-918d58814bf5 service nova] Creating event network-vif-plugged:b2321d87-7db4-4cc6-a9c8-6caeb967992e for instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 on hv-cinder-82880 May 26 21:28:20.815303 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-7cb2fe68-0c5b-4c7b-9eda-b9b44c46e929 req-15b59449-9b22-467a-a71e-918d58814bf5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 May 26 21:28:20.816215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 95/231] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:28:20.942711 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:20.952487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bae790a9-e12a-4e48-8c87-ae21dc67d546 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.383351 May 26 21:28:20.954500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 137/232] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:20 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:21.330521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:21.332105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:21.346396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.346856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:21.348458 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.351209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:21.495930 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:21.504834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fb9561fd-39e4-4f90-bf49-7d0de8dfb626 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1319 microversion: 2.1 time: 0.178927 May 26 21:28:21.505423 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 96/233] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:21 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:21.974698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:21.977296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:21.996730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.997468 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:21.998983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.999965 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.182539 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-ab1049bd-39de-4e45-a75a-549976263f6a req-49a409a2-b966-4089-b6a5-8e0d8676282e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:22.193337 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-ab1049bd-39de-4e45-a75a-549976263f6a req-49a409a2-b966-4089-b6a5-8e0d8676282e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.193949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-ab1049bd-39de-4e45-a75a-549976263f6a req-49a409a2-b966-4089-b6a5-8e0d8676282e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.211902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-ab1049bd-39de-4e45-a75a-549976263f6a req-49a409a2-b966-4089-b6a5-8e0d8676282e service nova] Creating event network-changed:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:28:22.218460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-ab1049bd-39de-4e45-a75a-549976263f6a req-49a409a2-b966-4089-b6a5-8e0d8676282e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039869 May 26 21:28:22.219786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 97/234] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:28:22.235359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:22.272748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-962cfbb3-7de7-4b61-a37b-c35450f3b10a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.304430 May 26 21:28:22.273495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 138/235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:21 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:22.528915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:22.530133 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:22.545879 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.547257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.550755 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.555553 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.762046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:22.771561 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-21ba4fc7-5c96-4584-96f1-e42d1178f013 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1512 microversion: 2.1 time: 0.253167 May 26 21:28:22.772750 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 98/236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:22 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:22.795287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:22.796415 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:22.803911 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.804614 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.805400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.805837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.837085 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'flavor' on Instance uuid d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:28:23.053681 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:23.290915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:23.291879 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:23.307597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.307597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.307897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cb9ff546-c9c0-41a5-b68f-1b074e740eaf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1/action" status: 200 len: 32 microversion: 2.1 time: 0.515435 May 26 21:28:23.307992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.307992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.310879 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 139/237] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:28:22 2022] POST /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1/action => generated 32 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:28:23.338415 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:23.340578 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:23.355098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.355728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.356901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.357536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.507129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:23.515409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-eb1ec746-cb6d-4440-9c40-d8be5de23ceb tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1367 microversion: 2.1 time: 0.228685 May 26 21:28:23.516033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 99/238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:23 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:23.573094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:23.581626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-be1b4a95-2cd2-4e1a-bfad-e2169527593a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.257532 May 26 21:28:23.583189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 140/239] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:23 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:24.532795 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:24.533549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:24.540238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.540671 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.541490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.541927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.602479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:24.603197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:24.615657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.617910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.619452 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.620265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.747666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:24.760352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-04805117-d7ad-43d9-9727-62dc78f1ab0f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1557 microversion: 2.1 time: 0.231346 May 26 21:28:24.764240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 100/240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:24 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:24.779142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:24.779800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:24.788609 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.789336 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.790515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.791141 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.799230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:24.807703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c68676f4-eac2-4b49-bd45-c6f7b5a483b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.211020 May 26 21:28:24.815955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 141/241] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:24 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:24.939380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ff402a59-b0af-4e34-8c54-3e52cb9c9ca5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165586 May 26 21:28:24.945421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 101/242] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:28:24 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:25.825917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:25.826801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:25.838748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:25.838748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:25.838748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:25.838748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:26.215629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:26.229342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8469bcda-f408-4a3f-985c-99310e6465d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.407057 May 26 21:28:26.231824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 142/243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:25 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:26.662196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-5819e9e9-5931-4f27-870a-14eeb508f3e0 req-3455690b-3be9-41cc-8616-fc1429d1d0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bec145-b7bb-413b-a4ee-124c14212c63", "tag": "2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:26.672320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5819e9e9-5931-4f27-870a-14eeb508f3e0 req-3455690b-3be9-41cc-8616-fc1429d1d0be service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:26.672857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5819e9e9-5931-4f27-870a-14eeb508f3e0 req-3455690b-3be9-41cc-8616-fc1429d1d0be service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:26.688370 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-5819e9e9-5931-4f27-870a-14eeb508f3e0 req-3455690b-3be9-41cc-8616-fc1429d1d0be service nova] Creating event network-changed:2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e for instance 94bec145-b7bb-413b-a4ee-124c14212c63 on hv-cinder-82880 May 26 21:28:26.699819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-5819e9e9-5931-4f27-870a-14eeb508f3e0 req-3455690b-3be9-41cc-8616-fc1429d1d0be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037445 May 26 21:28:26.709327 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 102/244] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:28:27.258251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:27.263247 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:27.280433 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:27.281251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:27.282880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:27.284080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:27.470393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:27.478789 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a5e3d7a7-2338-4039-bdf4-628d7fe1681a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.234716 May 26 21:28:27.481786 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 143/245] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:27 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:28.498657 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:28.499536 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:28.501769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=63 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:28.512223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.512223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.512223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.512223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.673831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:28.683347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-080cbde9-bab9-4978-9284-14b781bf8532 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.190288 May 26 21:28:28.684081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 103/246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:28 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:28.909769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:28.914529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:28.918201 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.918654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.920033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.920473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.954406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:28:29.344803 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f29da10d-5b3e-4dec-bc5a-bbe4af1bcc49 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 204 len: 0 microversion: 2.1 time: 0.439090 May 26 21:28:29.345688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 144/247] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:28:28 2022] DELETE /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:28:29.354945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:29.355583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:29.361880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.362331 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.363093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.363582 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.506478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:29.521352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-96e41a9b-1457-40e9-9ee7-56273c296c4d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1552 microversion: 2.1 time: 0.170284 May 26 21:28:29.522181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 104/248] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:29 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:29.701599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:29.702551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:29.710520 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.711300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.712364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.721210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.871562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:29.881994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5264b38d-3738-44f9-b3a1-9b0cbb847a79 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.184536 May 26 21:28:29.882700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 145/249] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:29 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:30.538399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:30.539184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:30.545873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:30.546633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:30.547752 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:30.548215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:30.687065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:30.695876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-08fee3c4-1cfc-4fdf-80d0-32be72eca35a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1552 microversion: 2.1 time: 0.161189 May 26 21:28:30.696455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 105/250] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:30 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:30.900423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:30.901292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:30.907930 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:30.908388 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:30.909335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:30.909958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:31.067426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:31.075436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0c8ed7cf-fca1-41ee-96f4-139166eb15f5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.179088 May 26 21:28:31.076063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 146/251] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:30 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:31.713907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:31.715140 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:31.722051 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:31.724066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:31.725092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:31.725983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:31.899806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:31.901261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:31.909308 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-04c557a4-da45-4df1-b97e-a7a8ebe3a176 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1552 microversion: 2.1 time: 0.199310 May 26 21:28:31.910446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 106/252] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:31 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:32.092838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:32.093369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:32.099844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.100376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.101216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.101659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.323230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:32.330788 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a6249b2e-e836-4434-99dc-3085d087cc2b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.242003 May 26 21:28:32.331352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 147/253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:32 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:32.514476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-569949ad-6aac-4164-b0c9-d3a4f57ba13a req-29399b94-8dd9-496a-a426-92fda96439bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c158d0-52d0-41c6-9ea3-ac90160e5ee0", "name": "network-vif-deleted", "tag": "42acb5d5-5de1-46a9-8982-343d8c9cf6ff"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:32.531115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-569949ad-6aac-4164-b0c9-d3a4f57ba13a req-29399b94-8dd9-496a-a426-92fda96439bd service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.531562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-569949ad-6aac-4164-b0c9-d3a4f57ba13a req-29399b94-8dd9-496a-a426-92fda96439bd service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.544127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-569949ad-6aac-4164-b0c9-d3a4f57ba13a req-29399b94-8dd9-496a-a426-92fda96439bd service nova] Creating event network-vif-deleted:42acb5d5-5de1-46a9-8982-343d8c9cf6ff for instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 on hv-cinder-82880 May 26 21:28:32.549534 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-569949ad-6aac-4164-b0c9-d3a4f57ba13a req-29399b94-8dd9-496a-a426-92fda96439bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039544 May 26 21:28:32.550417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 107/254] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:32.926886 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:32.927674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:32.934610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.935039 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.935832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.936301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.997805 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:33.005985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-eb1ff4ab-d77c-4770-ad3b-ab18eb8946f3 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1345 microversion: 2.1 time: 0.083534 May 26 21:28:33.006745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 148/255] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:32 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:33.352424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:33.354259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:33.364971 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:33.365633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:33.366997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:33.367620 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:33.536652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:33.547674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1899ae87-a8f0-42ab-b4c9-47c7e3f6f35b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.202385 May 26 21:28:33.548358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 108/256] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:33 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:34.029566 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:34.029566 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:34.034304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.034823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.036255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.038440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.075387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.076127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.076574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lazy-loading 'fault' on Instance uuid 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:28:34.132638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71302686cd59424ba952b49c0fad3577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199159bff7e5433ca3da168465c2e22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:34.140888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-383ddd3c-e9e7-4ffe-952d-da8f28108d56 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 200 len: 1304 microversion: 2.1 time: 0.122119 May 26 21:28:34.150735 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 149/257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:34 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:34.571384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:34.572345 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:34.578726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.579186 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.579984 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.580414 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.742354 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:34.750411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-65dc0dd7-ece9-4afa-bc06-b4d5453e380d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.182822 May 26 21:28:34.760092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 109/258] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:34 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:35.158093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:35.158731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:35.166102 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.166551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.167374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.167849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.183209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] HTTP exception thrown: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Request method failure captured: May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 HTTP/1.1 May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cf22FBZJG6nvXdpLb1qdkUoXXLkkmpZ34PIoQtz96tW3oywGE_OuaexlxcaU8W1vSgGH_DvlxWx_IOIaRTIy2ZPW7B9qOo_M9xEyQLCs8DSBmXdQ56mTibNRoGCOqyuVxQXnlO1grgu2p1qB7fHKa3xG4epIq9IdDU_ZzExfMYfXg May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:28:35.187822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_199159bff7e5433ca3da168465c2e22c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}] May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-DeleteServersTestJSON-919025023 May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 71302686cd59424ba952b49c0fad3577 May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.189346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '69c158d0-52d0-41c6-9ea3-ac90160e5ee0'} May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:28:35.190137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.191297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:35.192327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Returning 404 to user: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:28:35.192327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b7427ece-16c3-4bb9-8c13-9c7864cacae0 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 404 len: 111 microversion: 2.1 time: 0.035165 May 26 21:28:35.192327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 150/259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:35 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:28:35.311044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:35.312175 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:35.318115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.318828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.319488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.319959 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.333233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] HTTP exception thrown: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Request method failure captured: May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0/os-volume_attachments HTTP/1.1 May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cf22FBZJG6nvXdpLb1qdkUoXXLkkmpZ34PIoQtz96tW3oywGE_OuaexlxcaU8W1vSgGH_DvlxWx_IOIaRTIy2ZPW7B9qOo_M9xEyQLCs8DSBmXdQ56mTibNRoGCOqyuVxQXnlO1grgu2p1qB7fHKa3xG4epIq9IdDU_ZzExfMYfXg May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:28:35.338207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_199159bff7e5433ca3da168465c2e22c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}] May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-DeleteServersTestJSON-919025023 May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 71302686cd59424ba952b49c0fad3577 May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.339691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'server_id': '69c158d0-52d0-41c6-9ea3-ac90160e5ee0'} May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:28:35.342157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:35.343426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:35.344737 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Returning 404 to user: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:28:35.345080 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-01d04fe9-c609-4aa7-81b8-a7a75648acd6 tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034804 May 26 21:28:35.345717 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 110/260] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:28:35 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:28:35.767276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:35.767943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:35.774306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.774754 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.775573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.776061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.919289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:35.928737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0393769d-1903-48ef-bb8c-cf398276f8fa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.164516 May 26 21:28:35.929577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 151/261] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:35 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:36.946405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:36.947024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:36.953765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:36.954212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:36.954986 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:36.955419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:37.151171 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:37.158898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-54aba7e3-9944-4c82-90bf-15ea2c96636b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.216249 May 26 21:28:37.178709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 111/262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:36 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:38.195602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:38.196242 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:38.202697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:38.203181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:38.203993 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:38.204436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:38.372906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:38.380641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-02c9f0b4-022c-4a3f-a7ab-6db6c221c870 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.188979 May 26 21:28:38.381203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 152/263] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:38 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:39.398525 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:39.399243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:39.405960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.406422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.407192 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.407627 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.549107 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:39.557995 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-eb1392f6-3a51-4f91-bfdb-0b8279894614 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.164216 May 26 21:28:39.558586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 112/264] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:39 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:40.577770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:40.580262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:40.587916 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:40.591662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:40.591662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:40.591662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:40.733412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:40.741785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-af8cd9f3-c5b8-4cee-87b7-6933918ce86d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.170820 May 26 21:28:40.742412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 153/265] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:40 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:41.759066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:41.760121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:41.771642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:41.772421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:41.773551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:41.774772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:41.914993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:41.924455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a7f987e9-e857-4d7f-8ac5-7db4de7c7922 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.169871 May 26 21:28:41.935408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 113/266] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:41 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:42.943061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:42.943774 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:42.946563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:42.951654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:42.956664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:42.956664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:42.956664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:42.957331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:43.087512 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:43.094959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d2aaf0e4-b7b2-4792-9d00-fdbdb0e977dd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.156314 May 26 21:28:43.095516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 154/267] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:42 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:44.112381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:44.113015 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:44.119575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:44.120121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:44.120885 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:44.121315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:44.248106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:44.256085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-419dc712-c385-4818-bc57-e061e7e050d6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.147683 May 26 21:28:44.256649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 114/268] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:44 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:45.272836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:45.273383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:45.280662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:45.281141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:45.281921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:45.282365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:45.408183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:45.416341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7504ec20-94ec-4eea-bc62-14aae043e092 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.147435 May 26 21:28:45.416908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 155/269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:45 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:46.278355 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:46.278738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:46.284984 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.285429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.286187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.286613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.300194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] HTTP exception thrown: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Request method failure captured: May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 HTTP/1.1 May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cf22FBZJG6nvXdpLb1qdkUoXXLkkmpZ34PIoQtz96tW3oywGE_OuaexlxcaU8W1vSgGH_DvlxWx_IOIaRTIy2ZPW7B9qOo_M9xEyQLCs8DSBmXdQ56mTibNRoGCOqyuVxQXnlO1grgu2p1qB7fHKa3xG4epIq9IdDU_ZzExfMYfXg May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:28:46.302388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_199159bff7e5433ca3da168465c2e22c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}] May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-DeleteServersTestJSON-919025023 May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 71302686cd59424ba952b49c0fad3577 May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.304173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '69c158d0-52d0-41c6-9ea3-ac90160e5ee0'} May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:28:46.305024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.306502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:28:46.307858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Returning 404 to user: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:28:46.307858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-52c73c06-a44c-440d-931b-4bc066b9f86d tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 404 len: 111 microversion: 2.1 time: 0.029961 May 26 21:28:46.307858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 115/270] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:28:46 2022] DELETE /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:28:46.312741 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:46.314531 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] [instance: 69c158d0-52d0-41c6-9ea3-ac90160e5ee0] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:46.320214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.320853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.321715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.322071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.337363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] HTTP exception thrown: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Request method failure captured: May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 HTTP/1.1 May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cf22FBZJG6nvXdpLb1qdkUoXXLkkmpZ34PIoQtz96tW3oywGE_OuaexlxcaU8W1vSgGH_DvlxWx_IOIaRTIy2ZPW7B9qOo_M9xEyQLCs8DSBmXdQ56mTibNRoGCOqyuVxQXnlO1grgu2p1qB7fHKa3xG4epIq9IdDU_ZzExfMYfXg May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:28:46.338909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_199159bff7e5433ca3da168465c2e22c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/199159bff7e5433ca3da168465c2e22c"}]}] May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-DeleteServersTestJSON-919025023 May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 199159bff7e5433ca3da168465c2e22c May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-DeleteServersTestJSON-919025023 May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 71302686cd59424ba952b49c0fad3577 May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-DeleteServersTestJSON-919025023-project May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.340382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '69c158d0-52d0-41c6-9ea3-ac90160e5ee0'} May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:28:46.341148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. May 26 21:28:46.342472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:28:46.343969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] Returning 404 to user: Instance 69c158d0-52d0-41c6-9ea3-ac90160e5ee0 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:28:46.343969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-963f32c4-0140-40de-b60e-9f06e1b2af9a tempest-DeleteServersTestJSON-919025023 tempest-DeleteServersTestJSON-919025023-project] 10.222.0.42 "GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0" status: 404 len: 111 microversion: 2.1 time: 0.031608 May 26 21:28:46.343969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 156/271] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:46 2022] GET /compute/v2.1/servers/69c158d0-52d0-41c6-9ea3-ac90160e5ee0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:28:46.434073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:46.434685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:46.441906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.442357 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.443135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.443634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.581407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:46.589386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-93d2a989-3c2c-483d-8146-e48bbeba9f68 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.159346 May 26 21:28:46.589961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 116/272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:46 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:47.139126 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1327136382", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "networks": [{"uuid": "5700046f-4b5a-4ad3-a1d7-379e90370a51"}]}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:47.193842 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] validate_networks() for [('5700046f-4b5a-4ad3-a1d7-379e90370a51', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:28:47.606861 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:47.608214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:47.615612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.616500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.617376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.618155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.647354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:28:47.648410 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:28:47.649982 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:28:47.651062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:28:47.666558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:28:47.684161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.684943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.686386 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.688969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.728272 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Getting quotas for project 0a97f689104e4884b6e30b0c8606b513. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:28:47.733445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Getting quotas for user 6a658b1951a9426d94341940d87b5f95 and project 0a97f689104e4884b6e30b0c8606b513. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:28:47.749339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:28:47.751865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:28:47.796061 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:47.804288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-acaed0c8-e987-448b-8018-8efd7c7b83ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.201318 May 26 21:28:47.804961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 117/273] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:47 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:47.876719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-346cd812-fa22-4a6a-9e52-a873514117fd tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742247 May 26 21:28:47.880354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 157/274] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:28:47.893253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5c17c204-54f6-42dc-93d2-1aa0e8ae05f9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:47.895852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5c17c204-54f6-42dc-93d2-1aa0e8ae05f9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:47.991366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c17c204-54f6-42dc-93d2-1aa0e8ae05f9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:47.999297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5c17c204-54f6-42dc-93d2-1aa0e8ae05f9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1219 microversion: 2.1 time: 0.114730 May 26 21:28:48.000346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 118/275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:47 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:48.825635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:48.830658 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:48.841388 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:48.841876 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:48.842651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:48.843147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:48.988417 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:48.996032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-95a46740-5bc0-45ba-8d90-95c118e17863 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.177765 May 26 21:28:48.996974 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 158/276] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:48 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:49.017440 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:49.018599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:49.025274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:49.025759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:49.026683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:49.027242 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:49.092943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:49.101804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4dd36b2b-6d57-4238-9594-421f8bfe1375 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1223 microversion: 2.1 time: 0.088828 May 26 21:28:49.102378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 119/277] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:49 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:50.012256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:50.012871 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:50.019645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:50.021686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:50.021686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:50.021686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:50.119894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:50.120604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:50.127018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:50.127690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:50.130850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:50.130850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:50.172120 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:50.183986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-be62e792-1b68-4ce4-b051-ac0ef541f235 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.175745 May 26 21:28:50.186445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 159/278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:50 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:50.240524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:50.248646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-920ab015-e4c4-4f27-908e-78fc97567da9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1271 microversion: 2.1 time: 0.133156 May 26 21:28:50.249280 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 120/279] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:50 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:51.203017 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:51.204322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:51.220164 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.220164 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.221017 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.221820 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.265895 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:51.267213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:51.279121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.285412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.285412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.285412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.497957 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:51.504049 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-88bcbe3c-c2ce-4718-b813-10a59d983ed3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.242428 May 26 21:28:51.505194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 121/280] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:51 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:51.506532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:51.522834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7c024fee-f010-45af-be53-80f34171b9ae tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.324095 May 26 21:28:51.524307 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 160/281] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:51 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:52.322798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-00885040-5ead-4fa1-9495-324cf738ccb7 req-2f6d3d6d-9494-42ed-9b67-5f533af735b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b289518-380f-4d2c-b761-5ac6bf9e6ab4", "tag": "c02aef43-e795-46ef-a72d-a1fe076e05d9"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:52.333544 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-00885040-5ead-4fa1-9495-324cf738ccb7 req-2f6d3d6d-9494-42ed-9b67-5f533af735b6 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.334029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-00885040-5ead-4fa1-9495-324cf738ccb7 req-2f6d3d6d-9494-42ed-9b67-5f533af735b6 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.346793 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-00885040-5ead-4fa1-9495-324cf738ccb7 req-2f6d3d6d-9494-42ed-9b67-5f533af735b6 service nova] Creating event network-changed:c02aef43-e795-46ef-a72d-a1fe076e05d9 for instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 on hv-cinder-82880 May 26 21:28:52.352663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-00885040-5ead-4fa1-9495-324cf738ccb7 req-2f6d3d6d-9494-42ed-9b67-5f533af735b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 May 26 21:28:52.353484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 122/282] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:52.521904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:52.522656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:52.530133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.530831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.531852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.532510 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.541907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:52.542113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:52.554558 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.555710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.561115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.562440 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.793393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:52.802343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cb1644c3-a7a1-4124-a8ec-fffa92e106d9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.265924 May 26 21:28:52.804801 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 123/283] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:52 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:52.864605 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:52.872032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-815eb2c3-5478-4151-b04f-1b94527c508b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.354496 May 26 21:28:52.872607 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 161/284] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:52 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:53.822995 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:53.823556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:53.830507 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.831072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.831920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.832360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.889292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:53.890093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:53.897525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.898263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.899574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.901298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:54.068091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:54.076091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fb4b0c72-37f0-4a9e-8cdc-9e449fdc5b8f tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.191057 May 26 21:28:54.076543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 162/285] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:53 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:54.181690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:54.189845 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6a830565-1d66-4d99-8d62-da3e2b2191b4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.370784 May 26 21:28:54.190426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 124/286] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:53 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:55.093720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:55.094441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:55.101099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.102412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.103582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.104226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.207784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:55.208613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:55.223800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.224374 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.225374 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.225915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.247863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:55.259573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1e9f57c6-011c-469d-a1b9-b2effc785ceb tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.170042 May 26 21:28:55.260782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 163/287] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:55 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:55.374005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:55.383978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a618cb95-3239-4a3f-9d10-6827ba76f21f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.180981 May 26 21:28:55.384557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 125/288] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:55 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:56.276635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:56.277241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:56.283160 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:56.283610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:56.284407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:56.285437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:56.402824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:56.404970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:56.413078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:56.413656 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:56.415392 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:56.416126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:56.489753 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:56.498457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f4af8ffc-ac32-4ad5-a5c2-322d6466d463 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.225530 May 26 21:28:56.499275 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 164/289] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:56 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:56.603677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:56.617510 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-efa154d5-5b9a-4749-9678-138c909a7923 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.216130 May 26 21:28:56.617510 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 126/290] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:56 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:57.514623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:57.515313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:57.523989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:57.524949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.526091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:57.526756 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.633399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:57.636825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:57.640808 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:57.641262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.642081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:57.642522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.647919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:57.677589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:57.685421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d822b2cc-d4df-4297-956c-bf3d1ae3590e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.174595 May 26 21:28:57.688364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 165/291] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:57 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:57.792715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:57.801012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-25f6b3ac-268c-4978-9173-5537b07aad26 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.170911 May 26 21:28:57.801773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 127/292] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:57 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:58.703718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:58.704370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:58.707443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:58.708644 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=6 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:58.712256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.712908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.716055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.716055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.818271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:58.818841 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:58.824222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:58.826374 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.826834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.827625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.828270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.969269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:58.977731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-eb312641-cddc-4990-8473-784b8304f72a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.163823 May 26 21:28:58.990806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:58.991083 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 128/293] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:58 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:58.991189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dfc37268-ff65-480c-9ea8-b1a98c280f27 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.289191 May 26 21:28:58.991189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 166/294] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:58 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:59.997394 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:59.999508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:00.001054 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=54 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:00.005541 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:00.006325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:00.007065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.007518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.008420 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.008853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.014725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.015254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.016078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.016690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.177600 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:00.183761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:00.185424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7be81869-edb5-4018-9599-4e26b93b51ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.191940 May 26 21:29:00.186050 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 129/295] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:59 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:00.192189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-79a179f0-ee66-44eb-aa65-6255e77c850e tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.191323 May 26 21:29:00.192882 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 167/296] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:28:59 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:01.202894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:01.203565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:01.209445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:01.212598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:01.224632 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.225160 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.226634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.227281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.228421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.228860 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.244267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.245094 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.426698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:01.434511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:01.434955 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-058fdc31-8eef-4e34-bbc1-59a5c2aa6ac1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.236048 May 26 21:29:01.436041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 130/297] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:01 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:01.443912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a017d331-9921-4e7c-ad4f-014d3b9130e8 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.238730 May 26 21:29:01.452538 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 168/298] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:01 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:01.869822 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-f43a6344-e10c-4315-bc76-43863b204819 req-d55b21ea-2b3d-44dc-a500-1ab16390a0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b289518-380f-4d2c-b761-5ac6bf9e6ab4", "name": "network-vif-plugged", "status": "completed", "tag": "c02aef43-e795-46ef-a72d-a1fe076e05d9"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:01.884535 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f43a6344-e10c-4315-bc76-43863b204819 req-d55b21ea-2b3d-44dc-a500-1ab16390a0c9 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.885106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f43a6344-e10c-4315-bc76-43863b204819 req-d55b21ea-2b3d-44dc-a500-1ab16390a0c9 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.904320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-f43a6344-e10c-4315-bc76-43863b204819 req-d55b21ea-2b3d-44dc-a500-1ab16390a0c9 service nova] Creating event network-vif-plugged:c02aef43-e795-46ef-a72d-a1fe076e05d9 for instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 on hv-cinder-82880 May 26 21:29:01.909824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-f43a6344-e10c-4315-bc76-43863b204819 req-d55b21ea-2b3d-44dc-a500-1ab16390a0c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043758 May 26 21:29:01.910778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 131/299] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:02.465334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:02.466096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:02.467474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:02.470848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:02.482441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:02.482737 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:02.482939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:02.483130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:02.484416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:02.484867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:02.485039 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:02.485813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:02.719503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:02.730658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8a290fcd-a8b6-4d1d-98a5-992e9588df4c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.272494 May 26 21:29:02.732930 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:02.734665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 132/300] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:02 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:02.744785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d7d7891c-354f-4651-96d9-ed4fb5dc99f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.295194 May 26 21:29:02.745425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 169/301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:02 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:03.758587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:03.759248 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:03.767316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:03.767784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:03.768567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:03.769088 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:03.769209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:03.769807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:03.780037 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:03.780688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:03.782463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:03.783090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:03.937904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:03.946219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f3b02123-b177-4afb-a8d7-b94b05cb7ea1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.181295 May 26 21:29:03.956228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 170/302] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:03 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:04.000254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:04.010312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-85207109-c6a4-406e-b546-2b054db64660 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.262940 May 26 21:29:04.010901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 133/303] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:03 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:04.962149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:04.962862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:04.968771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:04.969231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:04.969998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:04.970436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:05.028004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:05.029182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:05.036397 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:05.036847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:05.037616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:05.038377 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:05.114672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:05.123315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1e8709fd-52c5-41ae-8025-064548e05286 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.161726 May 26 21:29:05.134056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 171/304] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:04 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:05.185963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:05.196178 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-47071df4-0d9a-44bd-ab2b-0adc521f5616 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.173346 May 26 21:29:05.205530 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 134/305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:05 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:06.145923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:06.146546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:06.152729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:06.153176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:06.153948 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:06.154382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:06.158591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:06.213986 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:06.215393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:06.232659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:06.233111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:06.233884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:06.234319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:06.375913 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:06.385929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f288cdca-65a6-4ca8-954d-29acf0adaa22 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.247039 May 26 21:29:06.387219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 172/306] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:06 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:06.408898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:06.418381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-73339712-4a88-4673-aa5b-07cf38496a13 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.208140 May 26 21:29:06.427983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 135/307] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:06 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:07.405592 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:07.406302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:07.426942 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:07.427962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:07.429091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:07.429689 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:07.438437 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:07.439819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:07.451162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:07.453365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:07.454804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:07.456996 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:07.816715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:07.837872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:07.842040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-95fc98c9-1376-4310-bc7a-a7957e1b55aa tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.443074 May 26 21:29:07.848566 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 173/308] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:07 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:07.863778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9bbccfb7-a818-4f6e-a510-e9086d45e2dc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.425765 May 26 21:29:07.868769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 136/309] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:07 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:08.873014 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:08.873891 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:08.875574 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:08.876728 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:08.883207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:08.887589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:08.887589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:08.887589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:08.887954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:08.887954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:08.888411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:08.888851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:09.092393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:09.101324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-266354ab-fc81-4fb1-833e-1acf10faa47a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1518 microversion: 2.1 time: 0.232838 May 26 21:29:09.108215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 174/310] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:08 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:09.140583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:09.149731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-579b87fc-6e60-4652-ba19-d7f81a04bf51 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1319 microversion: 2.1 time: 0.277951 May 26 21:29:09.159866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 137/311] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:08 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:10.119791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:10.120740 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:10.127593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:10.128873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:10.129671 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:10.130323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:10.169037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:10.169850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:10.187246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:10.187811 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:10.191716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:10.194642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:10.318662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:10.334409 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a530e4d2-aad4-4397-b085-13b04759e3de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1498 microversion: 2.1 time: 0.215377 May 26 21:29:10.334409 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 175/312] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:10 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1498 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:10.346620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:10.347461 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:10.354764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:10.355236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:10.356084 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:10.356684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:10.521547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:10.536404 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ffaa5d52-e8d2-4623-9bd9-deb5dc7fc21d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1507 microversion: 2.1 time: 0.368459 May 26 21:29:10.537399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 138/313] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:10 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:10.604899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:10.616976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-aa686975-d985-432e-9d24-1edcdff8bb3b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1514 microversion: 2.1 time: 0.274064 May 26 21:29:10.618158 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 176/314] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:10 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:13.396037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-81d29e31-ec69-4980-9af2-bff4c5a91604 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Action: 'create', calling method: .version_select at 0x7f7bc4dbc670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-80832212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPStguOeilL0i6GCACH3vbPHAxsYoILsr//iYXqY+JgR/6y3FeqLVd+Ouayz2fXjXCOLUMV9HWHVxZVLjHHGpZtrJkdOpUO5TONrs9sy3M8Cc+BFQwiFUm6pa8LK+L/bIA=="}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:13.414776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-81d29e31-ec69-4980-9af2-bff4c5a91604 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:29:13.422781 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-81d29e31-ec69-4980-9af2-bff4c5a91604 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for user 88575c0bd9db4fa8bc9bd511c0ac37dd and project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:29:13.567052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-81d29e31-ec69-4980-9af2-bff4c5a91604 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.564940 May 26 21:29:13.568150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 139/315] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:29:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:13.934579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:13.935616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:13.949325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:13.949777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:13.950574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:13.956274 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:13.996305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'flavor' on Instance uuid 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:29:14.335423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-98926ac4-af2a-470c-bbd4-fede85b498bc tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/action" status: 200 len: 32 microversion: 2.1 time: 0.406817 May 26 21:29:14.336241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 177/316] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:29:13 2022] POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:29:14.346104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:14.347425 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:14.356112 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:14.356569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:14.359071 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:14.359544 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:14.568196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:14.579034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-16374d52-5850-4035-8f3c-1874db0dab1e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.236966 May 26 21:29:14.579907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 140/317] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:14 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:15.601946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:15.603444 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:15.613176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:15.615889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:15.616662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:15.618057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:15.619435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:15.880841 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:15.901044 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2c1b5a28-d4f3-4429-b4ce-53145fadd2a2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.306712 May 26 21:29:15.902260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 178/318] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:15 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:16.919055 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:16.919680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:16.933100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:16.938343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:16.938343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:16.938343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:17.119012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:17.131542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c9727772-25bc-496d-a9fc-c1f02346dc32 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.216608 May 26 21:29:17.147831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 141/319] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:16 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:18.157445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:18.158556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:18.176049 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:18.179951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:18.181135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:18.181703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:18.356635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:18.364855 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7d466415-08e0-4197-9534-ac25b22fb814 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.211663 May 26 21:29:18.365532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 179/320] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:18 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:19.382278 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:19.382925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:19.392396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:19.392839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:19.396032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:19.396813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:19.684861 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:19.694771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b5e0662a-3ee2-4cae-9216-286e620822a1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.316664 May 26 21:29:19.696982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 142/321] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:19 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:20.713594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:20.714196 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:20.721680 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:20.722653 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:20.724899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:20.725499 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:20.871672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:20.879692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a348ee60-a515-4879-903b-511d62fca09e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.170265 May 26 21:29:20.880334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 180/322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:20 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:21.897554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:21.898820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:21.911932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:21.912405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:21.913681 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:21.914131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:22.063169 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:22.071301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-08c23104-d237-456d-86fb-619c2df131f4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.178679 May 26 21:29:22.071893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 143/323] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:21 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:23.089637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:23.092859 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:23.097310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:23.097761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:23.098646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:23.099124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:23.230747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:23.238233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-06dcddfb-798a-4e8f-bc30-8ee6fa0f0b90 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.152610 May 26 21:29:23.239004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 181/324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:23 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:24.255867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:24.256485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:24.259665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=4 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:24.264527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:24.264973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:24.265742 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:24.266191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:24.416784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:24.424831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5ca6fbb2-fa3c-441b-b529-4749747ded8d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.172950 May 26 21:29:24.425434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 144/325] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:24 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:25.447923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:25.448553 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:25.455297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:25.455985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:25.456763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:25.457193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:25.654598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:25.662738 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8232ad78-32f2-4ae5-8962-d2ce13a000e0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.223587 May 26 21:29:25.663412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 182/326] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:25 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:26.680722 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:26.681332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:26.691452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:26.692085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:26.693502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:26.694379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:26.718712 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:26.834988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:26.842569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e14521de-895b-4800-9b95-cec78ab841ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.166641 May 26 21:29:26.843127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 145/327] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:26 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:27.862408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:27.863024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:27.870995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:27.871455 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:27.872325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:27.872768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:28.084366 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:28.097258 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8cd71d4a-c269-4ff7-8b74-e819d60027fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.238796 May 26 21:29:28.097937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 183/328] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:27 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:29.115254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:29.116013 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:29.123847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:29.124304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:29.125101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:29.125698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:29.287339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:29.295213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-689e1a9b-9fb4-4f2d-bc7f-7b8471833659 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.184315 May 26 21:29:29.296155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 146/329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:29 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:30.313144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:30.313775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:30.320814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.321269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.322038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.322472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.467174 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:30.475381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8073866d-eb28-4026-a067-c8168be639fb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1500 microversion: 2.1 time: 0.165989 May 26 21:29:30.475928 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 184/330] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:30 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:30.498320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5311a9d4-d8f3-4f1d-9d95-d610154b88d2"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:30.498320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:30.500771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.501221 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.502188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.502628 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.552150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] HTTP exception thrown: Cannot 'attach_volume' instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 while it is in vm_state rescued May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Request method failure captured: May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/os-volume_attachments HTTP/1.1 May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 74 May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_C0GQ-INvXduMwRGm3c4_grfgBDzDAf36288IjzTjUlGN5KOZEPTFz1tsu5su5_qXahLBmX-nMCklW5U-v5JAVsuvZ9bMUL1HpZ0TlBEfT1Z3537_WDj0yIeFhry6wX2_uaUprVJOTtyS2h_zAdtBoy5cowHpeB5CvHyF_ShVtbKrc May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 318999cb1f874176b2523de9686febc1 May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:29:30.554139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_318999cb1f874176b2523de9686febc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/318999cb1f874176b2523de9686febc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}] May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 318999cb1f874176b2523de9686febc1 May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: ee4307a7bdf84fe18efd6ba3dbe50c23 May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {"volumeAttachment": {"volumeId": "5311a9d4-d8f3-4f1d-9d95-d610154b88d2"}} May 26 21:29:30.555422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Cannot 'attach_volume' instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 while it is in vm_state rescued May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'server_id': '5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9', 'body': {'volumeAttachment': {'volumeId': '5311a9d4-d8f3-4f1d-9d95-d610154b88d2'}}} May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:29:30.556241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 while it is in vm_state rescued May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:29:30.557788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 while it is in vm_state rescued May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Returning 409 to user: Cannot 'attach_volume' instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 while it is in vm_state rescued {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-61b878ca-f6f9-49d2-8ae8-3c05ac6ee465 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067615 May 26 21:29:30.559123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 147/331] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:29:30 2022] POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 21:29:30.564880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:30.565365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:30.572249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.572699 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.573482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.574030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.810886 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:30.934811 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-087a9cf1-0c6a-4b46-b267-f52455e83cd9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/action" status: 202 len: 0 microversion: 2.1 time: 0.373399 May 26 21:29:30.935682 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 185/332] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:29:30 2022] POST /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:29:30.949693 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:30.951015 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:30.959682 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.960204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:30.961016 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:30.961628 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:31.114898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:31.123406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dbe99a4c-70c9-4695-9063-46c917784bdf tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1508 microversion: 2.1 time: 0.179085 May 26 21:29:31.124039 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 148/333] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:30 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:32.141834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:32.142529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:32.149875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:32.150444 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:32.151295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:32.151688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:32.291934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:32.299734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3427a93b-7a78-4489-b28c-878977113cd4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1508 microversion: 2.1 time: 0.163486 May 26 21:29:32.300794 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 186/334] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:32 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:33.317391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:33.318430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:33.320746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:33.325738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:33.326193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:33.326953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:33.327396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:33.464952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:33.482921 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e603d08a-f305-4bc8-a6b0-afbaa4b857af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1508 microversion: 2.1 time: 0.160189 May 26 21:29:33.482921 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 149/335] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:33 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:34.490515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:34.491096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:34.497300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:34.497650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:34.498402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:34.498834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:34.634979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:34.643231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f61b1206-0c35-4134-b8f8-3c8643b781ac tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1508 microversion: 2.1 time: 0.156590 May 26 21:29:34.643813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 187/336] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:34 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:35.660852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:35.661460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:35.668757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:35.669213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:35.669980 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:35.670427 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:35.798588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:35.805839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-412eaafa-f78a-49b4-9f43-48aac7a6e4e4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1514 microversion: 2.1 time: 0.148821 May 26 21:29:35.806398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 150/337] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:35 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:38.471526 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-46505db9-3663-4996-9611-d11462e2bfeb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'create', calling method: .version_select at 0x7f7bc55b6b80>, body: {"keypair": {"name": "tempest-keypair-1051828551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRbn1ZDNSUF0H42uk8svw8lZHUrI5f5+henX3x77irj4LYR1xpJZelKCyj0Ca7L+qgqbWrilgfio2NqGsLgWr8oDDCf78eOP2wP2Sr4odehsybJA2UsIZj39d3OOw+uiQ=="}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:38.486171 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-46505db9-3663-4996-9611-d11462e2bfeb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for project 318999cb1f874176b2523de9686febc1. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:29:38.490029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-46505db9-3663-4996-9611-d11462e2bfeb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for user ee4307a7bdf84fe18efd6ba3dbe50c23 and project 318999cb1f874176b2523de9686febc1. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:29:38.565003 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-46505db9-3663-4996-9611-d11462e2bfeb tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097365 May 26 21:29:38.565606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 188/338] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:29:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:41.164346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-145489798", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a60ae016-a71c-495a-9bbe-63d3beeeb1fa"}], "security_groups": [{"name": "tempest-securitygroup--1881545635"}], "key_name": "tempest-keypair-1051828551", "user_data": "}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:41.282289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] validate_networks() for [('a60ae016-a71c-495a-9bbe-63d3beeeb1fa', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:29:41.682350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:29:41.682864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:29:41.683409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:29:41.683939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:29:41.684431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:29:41.702558 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:41.703211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:41.704239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:41.704803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:41.722962 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for project 318999cb1f874176b2523de9686febc1. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:29:41.727093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Getting quotas for user ee4307a7bdf84fe18efd6ba3dbe50c23 and project 318999cb1f874176b2523de9686febc1. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:29:41.738699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:29:41.741094 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:29:41.880505 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-20339b82-6379-4f18-ac80-677d7884fe28 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.721440 May 26 21:29:41.881152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 151/339] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:29:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:29:41.891984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b0e21a0e-315b-4e6e-845b-89fc830d6bc5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:41.893442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b0e21a0e-315b-4e6e-845b-89fc830d6bc5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:41.966038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b0e21a0e-315b-4e6e-845b-89fc830d6bc5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:41.978246 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b0e21a0e-315b-4e6e-845b-89fc830d6bc5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1245 microversion: 2.1 time: 0.091037 May 26 21:29:41.988555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 189/340] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:41 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:42.995652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:42.996419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:43.002706 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:43.003186 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:43.004067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:43.004573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:43.079846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:43.087344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-73d78684-f94d-4148-a248-c587448ab989 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1249 microversion: 2.1 time: 0.096679 May 26 21:29:43.087940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 152/341] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:42 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:44.104622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:44.105937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:44.112322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:44.112858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:44.113708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:44.114225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:44.202946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:44.210968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-15dfce20-ad0d-4a06-81fe-2108a05cb1e2 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1297 microversion: 2.1 time: 0.110700 May 26 21:29:44.216299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 190/342] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:44 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:45.231136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:45.232499 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:45.239599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:45.242814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:45.242814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:45.242814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:45.459101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:45.471657 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6d881d5b-5627-4426-b1fc-1606f1973dd6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.244364 May 26 21:29:45.478890 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 153/343] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:45 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:46.384229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-bfe69f99-e191-41cd-8a14-0c15cf116d73 req-83d3624a-9663-45b3-8144-ca7246466fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc04f2a-62bb-407b-b8d1-0e69eac279c2", "tag": "7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:46.397230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-bfe69f99-e191-41cd-8a14-0c15cf116d73 req-83d3624a-9663-45b3-8144-ca7246466fa1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:46.397230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-bfe69f99-e191-41cd-8a14-0c15cf116d73 req-83d3624a-9663-45b3-8144-ca7246466fa1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:46.416996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-bfe69f99-e191-41cd-8a14-0c15cf116d73 req-83d3624a-9663-45b3-8144-ca7246466fa1 service nova] Creating event network-changed:7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9 for instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 on hv-cinder-82880 May 26 21:29:46.431425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-bfe69f99-e191-41cd-8a14-0c15cf116d73 req-83d3624a-9663-45b3-8144-ca7246466fa1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051630 May 26 21:29:46.434723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 191/344] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:46.489153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:46.489904 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:46.511974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:46.511974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:46.514234 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:46.517417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:46.787897 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:46.809157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-060d7871-879a-439c-b986-b83706c590af tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.324010 May 26 21:29:46.812778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 154/345] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:46 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:47.538902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ddf5318-0bd4-4adc-b655-68f927c83731", "device": "/dev/sdb"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:47.540399 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:47.546819 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:47.547338 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:47.548242 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:47.548676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:47.828660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:47.829363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:47.836469 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:47.836940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:47.837735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:47.838159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:47.990456 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:47.998786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-48d1eff8-6c1c-4ef1-852b-f7a0decc87fd tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.174046 May 26 21:29:47.999352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 155/346] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:47 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:49.016307 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:49.016960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:49.023702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:49.024180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:49.025059 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:49.025494 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:49.182651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:49.190511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8cf3cc28-11a2-491d-a2c8-6ff386e5384d tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.178152 May 26 21:29:49.191298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 156/347] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:49 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:50.207951 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:50.208617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:50.216145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:50.216605 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:50.217377 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:50.217819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:50.359788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:50.367558 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-efc6ed72-918b-48bc-94fe-b088ec6cdba5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.163446 May 26 21:29:50.368197 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 157/348] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:50 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:51.384288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:51.384909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:51.391359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:51.391847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:51.392612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:51.393050 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:51.575957 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:51.584458 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b3a235d1-3b00-401e-8004-e88dedfbd63c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.203924 May 26 21:29:51.585899 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 158/349] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:51 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:51.970944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=6 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:52.603177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:52.607944 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:52.609595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:52.610220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:52.617896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:52.619213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:52.620092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:52.621154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:52.835448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:52.846452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0f5ce38d-73e9-47c0-942a-379fda5cf5ce tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.243911 May 26 21:29:52.857635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 159/350] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:52 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:53.867766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:53.873607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:53.883519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:53.885523 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:53.886353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:53.886857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:54.148769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:54.157640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-156f8d72-f1d6-43dc-9da1-007ee9ab30ec tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.294565 May 26 21:29:54.167835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 160/351] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:53 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:55.175457 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:55.176415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:55.183358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:55.183937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:55.184849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:55.185367 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:55.411576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:55.422073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8cee192f-45df-432e-a01c-ab3b39a8bc3a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.250741 May 26 21:29:55.422649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 161/352] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:55 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:56.439925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:56.441448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:56.452772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:56.453481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:56.454445 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:56.454887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:56.764907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:56.777258 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4e54b345-9cf3-4bcc-b6bc-7f5823f4157b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.340306 May 26 21:29:56.778479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 162/353] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:56 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:57.009873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-480edbdc-e532-4e3c-bfda-89f0bcc57a1b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "POST /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.476271 May 26 21:29:57.010838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 192/354] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:29:47 2022] POST /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4/os-volume_attachments => generated 194 bytes in 9478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:57.447257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2007951154", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-80832212", "security_groups": [{"name": "tempest-secgroup-smoke-389140089"}], "block_device_mapping_v2": [{"uuid": "4feb4aae-232c-4d1d-8581-1c1bd4afe4c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e9f896ed-3367-41b4-ace5-9c753fe1f6ff"}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:57.570997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] validate_networks() for [('e9f896ed-3367-41b4-ace5-9c753fe1f6ff', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:29:57.796497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:57.797583 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:57.804983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:57.809075 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:57.811780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:57.811780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:57.811780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:57.994926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:58.003718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6bf8e49d-9b9c-4b14-a58e-0d33c69465d5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.211513 May 26 21:29:58.004542 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 193/355] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:57 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:58.109627 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:29:58.114409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:29:58.115145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:29:58.115718 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:29:58.116908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:29:58.127265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:58.128206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:58.129388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:58.129901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:58.140290 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=99 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:58.154390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:29:58.160814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for user 88575c0bd9db4fa8bc9bd511c0ac37dd and project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:29:58.250367 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:29:58.250367 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4feb4aae-232c-4d1d-8581-1c1bd4afe4c3',volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:29:58.450986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-8c21305e-d502-4645-ba3d-408b779b6e4f req-b58ee5ba-87e3-46d7-9c3d-c3b979fc480b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc04f2a-62bb-407b-b8d1-0e69eac279c2", "name": "network-vif-plugged", "status": "completed", "tag": "7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:58.476384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-8c21305e-d502-4645-ba3d-408b779b6e4f req-b58ee5ba-87e3-46d7-9c3d-c3b979fc480b service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:58.476833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-8c21305e-d502-4645-ba3d-408b779b6e4f req-b58ee5ba-87e3-46d7-9c3d-c3b979fc480b service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:58.507308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-8c21305e-d502-4645-ba3d-408b779b6e4f req-b58ee5ba-87e3-46d7-9c3d-c3b979fc480b service nova] Creating event network-vif-plugged:7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9 for instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 on hv-cinder-82880 May 26 21:29:58.516406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-8c21305e-d502-4645-ba3d-408b779b6e4f req-b58ee5ba-87e3-46d7-9c3d-c3b979fc480b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069470 May 26 21:29:58.518427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 194/356] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:58.826283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fa01224a-4bcc-478b-9702-458557651c9a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.383719 May 26 21:29:58.832224 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 163/357] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:29:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:29:58.843288 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2c5eb26a-8469-48d7-8ced-3e1f42f81e34 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:58.849381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2c5eb26a-8469-48d7-8ced-3e1f42f81e34 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:58.958076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2c5eb26a-8469-48d7-8ced-3e1f42f81e34 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:58.967118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2c5eb26a-8469-48d7-8ced-3e1f42f81e34 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1093 microversion: 2.1 time: 0.129730 May 26 21:29:58.983543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 195/358] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:58 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1093 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:59.024373 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:59.025550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:59.034756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:59.041770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:59.041770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:59.041770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:59.274497 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:59.284379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-adb64e29-63f6-4980-9bf0-ea4389969c35 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.266185 May 26 21:29:59.284959 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 164/359] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:59 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:59.988289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-de84a046-7a00-46b8-a00b-782a287f3c3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:59.989555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-de84a046-7a00-46b8-a00b-782a287f3c3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:00.076551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-de84a046-7a00-46b8-a00b-782a287f3c3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:00.089807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-de84a046-7a00-46b8-a00b-782a287f3c3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1093 microversion: 2.1 time: 0.106934 May 26 21:30:00.090400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 196/360] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:29:59 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1093 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:00.307445 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:00.310096 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:00.326849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:00.327542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:00.328549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:00.329152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:00.632926 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:00.642458 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0f0b1057-c432-47c1-90cc-2b069ce221da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1371 microversion: 2.1 time: 0.344782 May 26 21:30:00.652215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 165/361] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:00 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:01.106642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:01.108226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:01.116554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:01.117975 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:01.119227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:01.120025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:01.225994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:01.235594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-650bdc13-529c-4eae-b0d1-229c3f4cf59a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1191 microversion: 2.1 time: 0.132948 May 26 21:30:01.239857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 197/362] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:01 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:01.666871 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:01.668105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:01.676766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:01.677724 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:01.679220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:01.679919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:01.954760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:01.968965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-675eb0e4-1de7-4037-b121-e14b6732704e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1565 microversion: 2.1 time: 0.308096 May 26 21:30:01.969833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 166/363] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:01 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1565 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:01.994892 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:01.995405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:02.004622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:02.005339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:02.006128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:02.006824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:02.177770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-68427da8-0450-4eca-914e-7f3fc911e666 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187226 May 26 21:30:02.180395 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 198/364] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:30:01 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:30:02.255484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:02.256144 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:02.265225 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:02.265821 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:02.266632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:02.267075 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:02.677614 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:02.698406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f2258d94-5e88-410a-87c2-3acb667c8515 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1191 microversion: 2.1 time: 0.449106 May 26 21:30:02.699852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 167/365] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:02 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1191 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:03.718840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:03.719477 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:03.739717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:03.745630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:03.745630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:03.745630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:03.838534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=50,nova_cell1:UPDATE=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:03.998046 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:04.008982 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-02cda78c-8230-4abc-84ff-27924444eb8f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1209 microversion: 2.1 time: 0.296842 May 26 21:30:04.035781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 199/366] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:03 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1209 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:04.794490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-02a80d34-971e-4437-8e1a-40bba72f149d req-3d9c007e-bc5b-4dfa-8eaf-669b5e36a395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc04f2a-62bb-407b-b8d1-0e69eac279c2", "tag": "7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:04.815130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-02a80d34-971e-4437-8e1a-40bba72f149d req-3d9c007e-bc5b-4dfa-8eaf-669b5e36a395 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.815783 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-02a80d34-971e-4437-8e1a-40bba72f149d req-3d9c007e-bc5b-4dfa-8eaf-669b5e36a395 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:04.877459 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-02a80d34-971e-4437-8e1a-40bba72f149d req-3d9c007e-bc5b-4dfa-8eaf-669b5e36a395 service nova] Creating event network-changed:7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9 for instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 on hv-cinder-82880 May 26 21:30:04.889838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-02a80d34-971e-4437-8e1a-40bba72f149d req-3d9c007e-bc5b-4dfa-8eaf-669b5e36a395 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107603 May 26 21:30:04.906701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 168/367] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:30:05.028393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:05.028393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:05.046384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:05.046799 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:05.050987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:05.051374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:05.415692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:05.432718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-723b4a1b-e974-4b01-8faa-0dc56aa12019 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1276 microversion: 2.1 time: 0.410291 May 26 21:30:05.435827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 200/368] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:05 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:06.453512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:06.454289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:06.462761 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:06.481813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:06.482256 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:06.483153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:06.483595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:06.982198 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-bef98a9f-16be-44f7-ac0e-c4bbea23f725 req-f35b3a65-b0a4-4cbd-a7d5-f6be6afd3e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e2b4ade-df77-4c06-bfc0-2a510bfe37d5", "tag": "1faef2ef-eecc-4157-ac0a-913c45525b24"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:06.998715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-bef98a9f-16be-44f7-ac0e-c4bbea23f725 req-f35b3a65-b0a4-4cbd-a7d5-f6be6afd3e73 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:06.999173 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-bef98a9f-16be-44f7-ac0e-c4bbea23f725 req-f35b3a65-b0a4-4cbd-a7d5-f6be6afd3e73 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:07.013700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-bef98a9f-16be-44f7-ac0e-c4bbea23f725 req-f35b3a65-b0a4-4cbd-a7d5-f6be6afd3e73 service nova] Creating event network-changed:1faef2ef-eecc-4157-ac0a-913c45525b24 for instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 on hv-cinder-82880 May 26 21:30:07.040353 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-bef98a9f-16be-44f7-ac0e-c4bbea23f725 req-f35b3a65-b0a4-4cbd-a7d5-f6be6afd3e73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061703 May 26 21:30:07.044385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 201/369] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:30:07.155688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:07.165734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f35b05f3-9c3b-42fa-a90d-6a81ba7ded56 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1276 microversion: 2.1 time: 0.716552 May 26 21:30:07.167304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 169/370] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:06 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1276 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:08.184958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:08.185946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:08.192987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:08.193448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:08.194796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:08.195239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:08.351697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:08.359980 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2c80dabd-13d9-4fd3-9d94-d1cbab086202 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.179232 May 26 21:30:08.370875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 202/371] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:08 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:09.379020 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:09.379625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:09.384172 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:09.385462 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:09.396100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:09.401128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:09.401128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:09.401128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:09.570117 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:09.592245 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3202222b-8138-4799-9568-65ecc45c1803 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.217387 May 26 21:30:09.593922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 170/372] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:09 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:10.647966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:10.653589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:10.660880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:10.664336 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:10.665145 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:10.666192 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:10.666812 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:10.908293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:10.933769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e88914b5-9aba-44ca-8a4d-15c1b70404f6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.321405 May 26 21:30:10.943178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 203/373] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:10 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:11.951111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:11.951714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:11.958463 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:11.958924 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:11.959715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:11.960184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:12.137700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:12.137700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5c5b3b37-38cc-43ec-a7a4-4c222dfb3853 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.176891 May 26 21:30:12.137700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 171/374] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:11 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:13.159037 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:13.159647 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:13.174295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:13.174750 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:13.175693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:13.176227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:13.392534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:13.401197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f0c1bce4-1b44-4ea7-85cb-07e23dd6b229 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.250263 May 26 21:30:13.403281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 204/375] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:13 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:14.424657 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:14.427863 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:14.433311 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:14.434079 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:14.435092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:14.435943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:14.583587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:14.592636 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ad17fa8f-6612-456b-9306-c88381b2dc5d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.172043 May 26 21:30:14.600257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 172/376] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:14 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:15.609491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:15.610664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:15.617222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:15.617804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:15.618787 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:15.619276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:15.777747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:15.785994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-aa2ec323-bbf9-4d49-8c89-d83b97493de6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.180472 May 26 21:30:15.786590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 205/377] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:15 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:16.806128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:16.807431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:16.813955 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:16.814401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:16.816435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:16.818681 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:16.987298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:16.995870 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-98f06281-45bc-43a7-9d87-5a93e00a31f7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.194450 May 26 21:30:16.997147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 173/378] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:16 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:18.014137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:18.014793 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:18.022253 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:18.022253 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:18.024043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:18.024043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:18.177898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:18.189100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-aa7df1c2-305a-477e-946a-1c2a062bc618 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.178949 May 26 21:30:18.190359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 206/379] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:18 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:19.210019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:19.210614 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:19.217358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:19.217799 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:19.218894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:19.219497 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:19.366593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:19.377021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a5d6bf62-f495-403f-8b19-e74430e73eb9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.171903 May 26 21:30:19.387614 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 174/380] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:19 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:20.300678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-45f9ef81-5e4a-4f0d-a16d-95c07e0df735 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Action: 'create', calling method: .version_select at 0x7f7bc5550a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-479145482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3xzr8GFHGCEQpR2z/S9F6dgI3Lg/LO6nArlsFLtstfMdLxK6CZxOgAzsXsEDlZD9DA3ESJmc3w8wlKNcWrcbIRGLbfS+yPxlnrICUYMtQmJmLqDVRW8BdAkJKW176IEA=="}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:20.315305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-45f9ef81-5e4a-4f0d-a16d-95c07e0df735 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Getting quotas for project 771d85ed5c3b4a6bbc9945d88cfcbab8. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:30:20.319543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-45f9ef81-5e4a-4f0d-a16d-95c07e0df735 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Getting quotas for user b9537b7add3b4b5da501903db49a2a11 and project 771d85ed5c3b4a6bbc9945d88cfcbab8. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:30:20.394566 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:20.395180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:20.402311 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:20.402755 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:20.403517 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:20.403991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:20.433938 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-45f9ef81-5e4a-4f0d-a16d-95c07e0df735 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.137043 May 26 21:30:20.434643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 207/381] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:30:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:30:20.490710 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1480688093", "imageRef": "1c1eac3a-b3f7-4951-8b5e-f4701bc028fa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-479145482", "networks": [{"uuid": "67963c39-9b8d-4e89-8021-57829e1176c5"}]}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:20.546136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:20.546876 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] validate_networks() for [('67963c39-9b8d-4e89-8021-57829e1176c5', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:30:20.554121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c39580fb-4bd9-4066-baf2-49c258b86735 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.163494 May 26 21:30:20.554686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 175/382] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:20 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:21.147230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:30:21.147674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:30:21.148182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:30:21.148631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:30:21.149042 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:30:21.158162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:21.158600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:21.159423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:21.159907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:21.175951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Getting quotas for project 771d85ed5c3b4a6bbc9945d88cfcbab8. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:30:21.180827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Getting quotas for user b9537b7add3b4b5da501903db49a2a11 and project 771d85ed5c3b4a6bbc9945d88cfcbab8. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:30:21.191387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:30:21.193597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c1eac3a-b3f7-4951-8b5e-f4701bc028fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:30:21.319495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5c50fe5a-23a8-483e-954f-0aedcc63f977 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836153 May 26 21:30:21.320471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 208/383] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 21:30:21.329980 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c3616725-6a3a-42ad-b196-f06c88a7191d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:21.330609 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c3616725-6a3a-42ad-b196-f06c88a7191d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:21.389776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c3616725-6a3a-42ad-b196-f06c88a7191d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:21.396646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c3616725-6a3a-42ad-b196-f06c88a7191d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1258 microversion: 2.1 time: 0.070480 May 26 21:30:21.397297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 176/384] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:21 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:21.572113 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:21.574669 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:21.579949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:21.580402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:21.581169 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:21.581600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:21.726142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:21.734025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7151d10b-7ab7-44c1-b5d1-90c7b1e9715a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.166198 May 26 21:30:21.734586 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 209/385] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:21 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:22.414466 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:22.415159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:22.421910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:22.422389 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:22.423177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:22.423616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:22.502311 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:22.510997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f23fa63d-7e39-4363-bb84-5c83dbd2f8cd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1262 microversion: 2.1 time: 0.101189 May 26 21:30:22.511595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 177/386] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:22 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1262 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:22.750405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:22.751037 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:22.758098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:22.758548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:22.759324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:22.759785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:22.896742 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:22.904431 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e20faecd-72d9-4140-835e-ead9661199e6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.157926 May 26 21:30:22.904992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 210/387] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:22 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:23.530301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:23.530970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:23.537896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.538349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:23.539133 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.539568 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:23.604134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:23.613384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-79161f1b-6bd1-4fd8-bb4a-76b8e2cfb17f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1262 microversion: 2.1 time: 0.086834 May 26 21:30:23.614298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 178/388] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:23 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:23.922518 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:23.923054 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:23.929626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.930063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:23.931340 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.931827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.073552 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.081356 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ebb39484-2738-4f85-bdf8-b723a66a2a00 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.163339 May 26 21:30:24.081994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 211/389] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:23 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:24.631236 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:24.631778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:24.638325 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.638765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.639521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.639985 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.708581 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.716813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-14094b4e-7fde-420d-890c-2801693a1af3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1262 microversion: 2.1 time: 0.089674 May 26 21:30:24.717372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 179/390] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:24 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:25.098562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:25.099216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:25.106855 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.108446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.108446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.108680 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.251824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:25.260249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-06f413cf-2ee9-4dcb-a790-07542ce5cd0d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.165400 May 26 21:30:25.261098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 212/391] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:25 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:25.734138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:25.734904 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:25.741508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.742056 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.742931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.744037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.809724 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:25.819156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-82d0d172-46c8-4bda-87c5-c9a18b848b85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1254 microversion: 2.1 time: 0.088750 May 26 21:30:25.820063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 180/392] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:25 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1254 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:26.277914 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:26.278577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:26.285856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.286225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.287021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.287448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.440532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:26.449467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8151e2d5-70b8-4958-a722-e8fe4bd06881 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.176088 May 26 21:30:26.449981 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 213/393] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:26 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:26.837540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:26.838169 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:26.844997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.845448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.846235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.846687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.910685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:26.918321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-01457978-687d-4bf9-9e6a-76e5c0101c35 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1254 microversion: 2.1 time: 0.085278 May 26 21:30:26.918896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 181/394] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:26 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1254 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:27.475949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:27.476607 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:27.484055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.484514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.485318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.485767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.652399 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:27.667296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2dd0959e-97b4-49a5-ab40-20ef2ec8b621 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.195035 May 26 21:30:27.668424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 214/395] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:27 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:27.936528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:27.938180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:27.951689 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.952259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.953361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.954027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.960107 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:28.056827 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:28.067040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dbdd58c5-13ae-4eb5-b0fd-dfe371e852a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1310 microversion: 2.1 time: 0.134936 May 26 21:30:28.067628 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 182/396] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:27 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1310 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:28.686464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:28.687094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:28.690814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:28.696437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.696896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.697700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.698144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:29.021926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:29.033212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fbf4f968-895e-42a2-aa89-2f553bde64fe tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.350634 May 26 21:30:29.035328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 215/397] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:28 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:29.084890 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:29.085505 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:29.094411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:29.094869 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:29.100613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:29.100613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:29.261116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:29.272299 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-95c050cd-8d1c-45f8-98c6-8dfd4032aca3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.191137 May 26 21:30:29.274093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 183/398] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:29 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:30.052845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:30.053644 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:30.060808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:30.061296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:30.062060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:30.062491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:30.205625 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:30.215344 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b65bcbe7-3c0e-4a5a-90aa-e300a81388c2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.166816 May 26 21:30:30.215986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 216/399] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:30 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:30.300663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:30.301208 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:30.309007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:30.309599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:30.310416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:30.310860 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:30.442648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:30.450448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ac266a5d-4901-4942-ac0f-5cbaa9ce1952 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.153725 May 26 21:30:30.451029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 184/400] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:30 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:31.232440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:31.233044 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:31.235367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:31.236051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=10 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:31.240968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:31.241407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:31.242178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:31.242742 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:31.387977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:31.396161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0f0f8a73-ce00-40f9-8eb9-534ffdf25c38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.167204 May 26 21:30:31.396728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 217/401] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:31 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:31.467763 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:31.468382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:31.470696 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:31.476034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:31.476478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:31.477398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:31.478344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:31.615773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:31.624398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6aedfdbe-c927-46e2-87f1-adf8f9909af6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.160881 May 26 21:30:31.625102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 185/402] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:31 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:32.413800 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:32.414408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:32.421708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:32.422151 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:32.422914 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:32.423349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:32.426195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:32.570412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:32.574455 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c0dc5e0d-6251-473d-8925-69b7b10276b1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.164550 May 26 21:30:32.575021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 218/403] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:32 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:32.645230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:32.645230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:32.649072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:32.649531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:32.650313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:32.650750 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:32.793431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:32.801159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fefe03ae-0f7c-452e-b05e-54fb4733051f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.163593 May 26 21:30:32.801989 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 186/404] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:32 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:33.590730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:33.591404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:33.598803 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:33.600824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:33.603336 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:33.603336 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:33.749471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:33.757671 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-32e57107-5da3-4232-8a8c-eb2ceb44ecb1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.170799 May 26 21:30:33.758387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 219/405] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:33 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:33.818438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:33.819277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:33.826809 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:33.827351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:33.828227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:33.828671 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:33.966018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:33.974076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-baff5b1d-d7e2-419f-bced-5b9ffcda683d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.159544 May 26 21:30:33.974681 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 187/406] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:33 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:34.776767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:34.777376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:34.784924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:34.786274 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:34.787608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:34.788364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:34.929151 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:34.936875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bf6e966c-3d21-425b-926b-ee12705621a5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.164591 May 26 21:30:34.937440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 220/407] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:34 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:34.993448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:34.994119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:35.000739 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:35.001243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:35.002014 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:35.002441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:35.139793 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:35.148052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d8047f00-fcda-46ee-8dc1-94e22e3b8f67 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.159061 May 26 21:30:35.148652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 188/408] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:34 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:35.717602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:35.718248 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:35.724909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:35.725362 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:35.726186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:35.726612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:35.754327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-004c5e70-f7ff-4a13-9687-3cca7917de10 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/ips" status: 200 len: 152 microversion: 2.20 time: 0.040337 May 26 21:30:35.755633 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 221/409] 10.222.0.42 () {60 vars in 1288 bytes} [Thu May 26 21:30:35 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:30:35.954963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:35.956032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:35.965612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:35.968393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:35.969533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:35.970095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:36.112728 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:36.127864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1ef87dfd-807e-46be-89cd-f284ad13e836 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.177629 May 26 21:30:36.128786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 189/410] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:35 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:36.171343 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:36.172018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:36.181417 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:36.181898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:36.182684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:36.183123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:36.191078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-5d49dbcd-cb86-40b9-8cef-b6c3430e44f5 req-8e7cbe2e-d189-46e5-badf-69d460f99cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:36.213409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5d49dbcd-cb86-40b9-8cef-b6c3430e44f5 req-8e7cbe2e-d189-46e5-badf-69d460f99cb5 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:36.213853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5d49dbcd-cb86-40b9-8cef-b6c3430e44f5 req-8e7cbe2e-d189-46e5-badf-69d460f99cb5 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:36.238502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-5d49dbcd-cb86-40b9-8cef-b6c3430e44f5 req-8e7cbe2e-d189-46e5-badf-69d460f99cb5 service nova] Creating event network-changed:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:30:36.255239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-5d49dbcd-cb86-40b9-8cef-b6c3430e44f5 req-8e7cbe2e-d189-46e5-badf-69d460f99cb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066088 May 26 21:30:36.255239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 190/411] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:30:36.380113 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:36.391177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cb2481ea-2b7f-4bc0-8dec-0f3b7b652ec4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.229559 May 26 21:30:36.392623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 222/412] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:36 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:37.152014 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:37.153041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:37.166194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:37.172098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:37.172098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:37.172098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:37.334118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:37.342448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bc56f868-8864-4586-b8ba-029a355b177e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.200652 May 26 21:30:37.343018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 191/413] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:37 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:37.411078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:37.412046 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:37.421852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:37.428178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:37.428178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:37.428178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:37.600945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:37.610504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7332087c-0646-484b-8efd-14acaab3413d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.204196 May 26 21:30:37.611098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 223/414] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:37 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:38.360920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:38.362775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:38.370686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:38.371157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:38.371966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:38.372401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:38.555226 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:38.564384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8727e26f-277e-420f-b6f6-a6e60e1c20b5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.208539 May 26 21:30:38.576119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 192/415] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:38 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:38.632059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:38.632670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:38.641851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:38.642622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:38.644035 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:38.645205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:38.818433 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:38.826706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-71ee7464-64bb-4db5-89f4-62673591e831 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.198343 May 26 21:30:38.827201 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 224/416] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:38 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:39.585587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:39.587138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:39.589931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=50 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:39.595655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:39.596159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:39.596990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:39.597432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:39.749610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:39.757557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3ffe6756-516c-485c-8aa4-6ffa252cbb05 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.176827 May 26 21:30:39.758145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 193/417] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:39 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:39.845833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:39.846511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:39.854264 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:39.854714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:39.855503 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:39.855985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:40.003488 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:40.015098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-03764573-5bce-4a61-961c-a7bb5d301623 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.172255 May 26 21:30:40.015098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 225/418] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:39 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:40.335824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:40.336374 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:40.343088 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:40.343552 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:40.344630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:40.345199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:40.369487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lazy-loading 'flavor' on Instance uuid 73c36399-8b1a-4b08-b284-8a3900a10d73 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:30:40.417134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-9078c968-cdd1-4fcc-9946-31c94303c6eb req-a0154a5b-b6ba-4d20-926f-4a8d698c2a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e2b4ade-df77-4c06-bfc0-2a510bfe37d5", "name": "network-vif-plugged", "status": "completed", "tag": "1faef2ef-eecc-4157-ac0a-913c45525b24"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:40.432735 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-9078c968-cdd1-4fcc-9946-31c94303c6eb req-a0154a5b-b6ba-4d20-926f-4a8d698c2a5e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:40.433333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-9078c968-cdd1-4fcc-9946-31c94303c6eb req-a0154a5b-b6ba-4d20-926f-4a8d698c2a5e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:40.448550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-9078c968-cdd1-4fcc-9946-31c94303c6eb req-a0154a5b-b6ba-4d20-926f-4a8d698c2a5e service nova] Creating event network-vif-plugged:1faef2ef-eecc-4157-ac0a-913c45525b24 for instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 on hv-cinder-82880 May 26 21:30:40.453875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-9078c968-cdd1-4fcc-9946-31c94303c6eb req-a0154a5b-b6ba-4d20-926f-4a8d698c2a5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041088 May 26 21:30:40.454484 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 226/419] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:30:40.777219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:40.782701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:40.784497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:40.784961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:40.785754 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:40.786186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:40.933080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:40.943015 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d9449e39-018c-4e88-a762-dd6f4cfcfcfb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.169980 May 26 21:30:40.943588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 227/420] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:40 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:41.031544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:41.032082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:41.038620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:41.039071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:41.040438 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:41.040995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:41.154683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-44369533-9296-4350-83f3-8f29203c2240 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/action" status: 202 len: 0 microversion: 2.20 time: 0.822452 May 26 21:30:41.155630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 194/421] 10.222.0.42 () {62 vars in 1318 bytes} [Thu May 26 21:30:40 2022] POST /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:30:41.167141 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:41.168314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:41.174814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:41.175264 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:41.176080 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:41.176787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:41.189546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:41.203154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ab9191e7-6b90-4102-9e2a-cc19a3fa1202 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.175648 May 26 21:30:41.214314 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 228/422] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:41 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:41.343780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:41.353580 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:41.355158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:41.356364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3f1475e5-9074-4088-a3e1-407a2abd8fe2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.196233 May 26 21:30:41.364773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 195/423] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:41 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:30:41.960687 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:41.961319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:41.968612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:41.969061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:41.969825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:41.970255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:42.113649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:42.121766 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d75b3a0b-6dc0-473b-9316-fc28e45f68e3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.164925 May 26 21:30:42.122349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 229/424] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:41 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:42.221670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:42.222281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:42.229322 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:42.229774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:42.230550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:42.230983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:42.375988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:42.376648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:42.386770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:42.387299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:42.388082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:42.388531 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:42.391230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:42.405758 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-efe47127-e5f6-4064-8efa-dad140eca1d7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.187319 May 26 21:30:42.410196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 196/425] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:42 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:42.556405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:42.569908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:42.579320 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:42.580659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-edf6d11f-4455-4ccb-befc-f61d124ad55b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.208822 May 26 21:30:42.581233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 230/426] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:42 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:30:43.144476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:43.145006 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:43.151229 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:43.151680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:43.152488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:43.152921 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:43.169765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:43.309780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:43.319675 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cb4dbed3-8667-445a-91c0-e2b9fa4e8ea3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.178979 May 26 21:30:43.321109 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 197/427] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:43 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:43.426648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:43.427543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:43.434181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:43.434622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:43.435391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:43.435860 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:43.595422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:43.599124 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:43.599813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:43.605418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4a17c653-e623-4401-8e72-86deafb457eb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.184999 May 26 21:30:43.606080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 231/428] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:43 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:43.613468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:43.613468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:43.613468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:43.613468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:43.759211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:43.767469 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:43.773786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:43.773786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0a287ee2-40b2-4859-aac2-012a63a5acb5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.175516 May 26 21:30:43.773786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 198/429] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:43 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:30:44.011610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:44.012513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:44.019437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.019917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.020705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.021143 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.155643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lazy-loading 'services' on Instance uuid 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:30:44.338837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:44.339716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:44.347441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.347931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.348808 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.349242 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.422530 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a16bb82d-4bc7-40dd-a22a-55bb94d294b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4/os-volume_attachments/6ddf5318-0bd4-4adc-b655-68f927c83731" status: 202 len: 0 microversion: 2.1 time: 0.415071 May 26 21:30:44.423316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 232/430] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:30:44 2022] DELETE /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4/os-volume_attachments/6ddf5318-0bd4-4adc-b655-68f927c83731 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:30:44.504831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:44.512865 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5fcb122e-903a-4e18-b424-367fd6f24e4a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.178193 May 26 21:30:44.513357 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 199/431] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:44 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:44.623571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:44.624475 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:44.633135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.633910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.634772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.635142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.784912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:44.791368 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:44.792447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:44.796649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e23ec6d2-a338-49b1-9ed6-ccfd58b31c94 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.177251 May 26 21:30:44.802533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.803319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.804381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 233/432] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:44 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:44.804570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:44.805278 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:44.970743 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:44.981858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:44.983396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:44.984644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b6df71ee-3dbf-4038-ad49-23264102a73a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.199324 May 26 21:30:44.985206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 200/433] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:44 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:30:45.530988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:45.531728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:45.538637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:45.539099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:45.539918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:45.540360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:45.692534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:45.703299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1244c335-47ad-41c7-9932-06081c7cb12a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.176507 May 26 21:30:45.704094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 234/434] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:45 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:45.813501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:45.814072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:45.821612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:45.822057 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:45.822815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:45.823249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:45.970871 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:45.979725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d9f94602-b48d-4b04-9915-610a68cd059a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.170035 May 26 21:30:45.980529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 201/435] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:45 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:46.002714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:46.003330 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:46.009979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:46.010431 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:46.011214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:46.011656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:46.015985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:46.149769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:46.158409 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:46.159946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:46.161111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-30193f32-1f9f-47cc-a6de-fefd3a043fe5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.162462 May 26 21:30:46.161680 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 235/436] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:45 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:46.720699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:46.721321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:46.731716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:46.732195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:46.732981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:46.733417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:46.899726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:46.907600 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bbfcf653-0c0c-44b3-80ec-6bb0353d2223 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.191061 May 26 21:30:46.908613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 202/437] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:46 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:46.996695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:46.997304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:47.004641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:47.005097 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:47.005883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:47.006321 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:47.156516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:47.164108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-91410e5f-de87-4130-b3d8-936a8b583c5c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.171307 May 26 21:30:47.164706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 236/438] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:46 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:47.181041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:47.182819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:47.188550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:47.189000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:47.189908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:47.190348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:47.328912 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:47.336815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:47.338350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:47.339502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d0e806aa-f521-41b0-9ad0-98ff7c0ee370 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.163161 May 26 21:30:47.340176 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 203/439] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:47 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:47.925554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:47.926165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:47.933217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:47.933697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:47.934478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:47.934915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:48.080341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:48.093157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ac47e459-6614-48f0-b4e8-aa34c35ebae3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.171382 May 26 21:30:48.094691 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 237/440] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:47 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:48.181246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:48.181858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:48.188547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:48.188914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:48.189739 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:48.190181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:48.341642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:48.350717 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-57f25911-6345-488a-9e32-1e5a5470fc4a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.173180 May 26 21:30:48.351475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 204/441] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:48 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:48.357775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:48.358383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:48.364606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:48.365061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:48.365845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:48.366463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:48.505290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:48.513858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:48.515359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:48.516574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9b7d7a72-8c7a-459b-b5fc-5d30aa3d472b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.162834 May 26 21:30:48.517118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 238/442] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:48 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:49.114380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:49.115319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:49.122150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:49.122600 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:49.123372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:49.123831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:49.281032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:49.294621 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1abf8687-f0c3-43eb-aece-cf1176e77124 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.183975 May 26 21:30:49.295209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 205/443] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:49 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:49.367968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:49.369235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:49.375521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:49.375998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:49.376786 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:49.377222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:49.530075 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:49.536458 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:49.538182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:49.541563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1f693b38-d978-4cee-9168-7662fa704128 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.177468 May 26 21:30:49.542513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 239/444] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:49 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:49.546335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:49.546794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:49.547726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:49.548441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:49.694159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:49.703189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:49.705034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:49.706397 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3a60c62b-7a70-4627-a61a-f999e35cda2b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.174081 May 26 21:30:49.707192 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 206/445] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:49 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:50.312227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:50.312834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:50.319361 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:50.320085 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:50.321759 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:50.322384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:50.481357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:50.489768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-729f3a86-e99c-471a-9fef-4969d7b1e93f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.181250 May 26 21:30:50.490348 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 240/446] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:50 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:50.559148 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:50.560502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:50.567380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:50.567893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:50.568708 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:50.569146 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:50.713486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:50.721588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5c7ff40d-e1b3-4e95-90a5-f4d358ecbf56 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.166986 May 26 21:30:50.722666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 207/447] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:50 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:50.728536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:50.729383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:50.736405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:50.736862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:50.737648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:50.738158 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:50.873901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:50.882053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:50.883581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:50.884765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ce927c8e-2f10-468a-b38c-318d87454b08 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.162522 May 26 21:30:50.885334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 241/448] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:50 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:51.508098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:51.508956 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:51.515515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:51.515994 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:51.516877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:51.517323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:51.667365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:51.675912 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b0f30d8b-00b2-4f36-8ec1-531502f015bf tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.171976 May 26 21:30:51.676773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 208/449] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:51 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:51.739101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:51.740555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:51.747646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:51.748401 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:51.749358 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:51.749971 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:51.893168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:51.902914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:51.904089 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:51.906276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6c50b37e-b752-40b0-8aa9-1370a2cc500b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.168037 May 26 21:30:51.907812 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 242/450] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:51 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:51.921211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:51.921752 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:51.923099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:51.923809 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:52.068636 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:52.077538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:52.079059 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:52.080249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4af6bb8e-9346-45e7-a031-3d277199b9b6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.181735 May 26 21:30:52.080812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 209/451] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:51 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:52.696418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:52.697017 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:52.703280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:52.703728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:52.704513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:52.704951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:52.837993 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:52.845708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d5057c20-1030-4364-9e1a-85fe817e778c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.153971 May 26 21:30:52.846210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 243/452] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:52 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:52.922975 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:52.923610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:52.931068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:52.931518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:52.932318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:52.932759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:53.058874 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:53.066266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a9f49706-b657-4bde-ae9f-7295168f8e30 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.147332 May 26 21:30:53.066824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 210/453] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:52 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:53.098229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:53.098834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:53.105629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:53.106079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:53.106847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:53.107290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:53.233621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:53.241616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:53.243136 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:53.244309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-19adc2fb-6143-4903-bb05-3e507ea9a181 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.149943 May 26 21:30:53.244873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 244/454] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:53 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:53.862453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:53.863174 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:53.869918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:53.870368 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:53.871133 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:53.871568 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:54.002379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:54.010369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6c4ced6b-812b-412a-b599-f274ea2d5047 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.151787 May 26 21:30:54.010970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 211/455] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:53 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:54.082273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:54.082901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:54.089589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:54.090032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:54.091119 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:54.091560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:54.222483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:54.230961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f9cf62ef-ee26-40e9-9020-1bcce3ac27dd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.152524 May 26 21:30:54.231550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 245/456] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:54 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:54.261785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:54.262382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:54.269011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:54.269453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:54.270222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:54.270660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:54.400316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:54.408230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:54.409755 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:54.410902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3851f417-0e32-4f9b-87c2-41ccfcedaf8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.153103 May 26 21:30:54.411449 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 212/457] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:54 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:55.028035 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:55.028646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:55.034706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:55.035154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:55.035946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:55.036388 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:55.172232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:55.180448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ced4cfc4-fd44-4c85-8f93-b78039894af7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.156825 May 26 21:30:55.181110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 246/458] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:55 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:55.247586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:55.248211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:55.254633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:55.255082 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:55.255945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:55.256387 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:55.381884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:55.389778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ade47ad7-9096-4626-b5df-a2db58de3de6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.146023 May 26 21:30:55.390349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 213/459] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:55 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:55.429530 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:55.430678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:55.436751 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:55.437200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:55.438577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:55.438577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:55.565616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:55.574331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:55.575997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:55.577207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4ac2d8cf-5193-4a81-af49-6e488aa8c8a3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.151848 May 26 21:30:55.577772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 247/460] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:55 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:56.197152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:56.197786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:56.203796 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:56.204241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:56.205002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:56.205435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:56.207922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:56.339327 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:56.346858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4fc22ccf-793f-4d06-bdd7-47268f6f8813 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.153508 May 26 21:30:56.347416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 214/461] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:56 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:56.406168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:56.406770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:56.413284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:56.413733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:56.415099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:56.415538 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:56.544157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:56.551802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7ff01886-5ef7-486a-b9f6-a5e05ebfa704 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.149124 May 26 21:30:56.552367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 248/462] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:56 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:56.594464 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:56.595064 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:56.601135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:56.601583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:56.602349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:56.602783 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:56.728298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:56.736153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:56.737674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:56.738821 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-865e5617-7bd0-4b93-9007-0c8d610094f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.148267 May 26 21:30:56.739383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 215/463] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:56 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:57.364147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:57.364755 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:57.371367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:57.371844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:57.372610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:57.373047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:57.500966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:57.508872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-70a6166b-caf2-49bb-9de4-b560e16e828c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.148539 May 26 21:30:57.512897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 249/464] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:57 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:57.569761 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:57.571542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:57.577405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:57.577922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:57.578723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:57.579174 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:57.739504 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:57.742844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e07c496d-f7ae-46ec-aa58-f9d6f71a347e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.178197 May 26 21:30:57.743412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 216/465] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:57 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:57.756328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:57.756934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:57.762963 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:57.768183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:57.768183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:57.768183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:57.942893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:57.951429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:57.952968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:57.954112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c75cb507-ac01-48f1-a5f9-9a1970f21504 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.201805 May 26 21:30:57.954670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 250/466] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:57 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:58.526138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:58.526747 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:58.532738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:58.533189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:58.533950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:58.534387 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:58.662252 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:58.670376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5701ffb2-e746-48ba-9680-73c2507f906d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.148625 May 26 21:30:58.671177 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 217/467] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:58 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:58.760283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:58.761002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:58.767517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:58.768060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:58.768920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:58.769420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:58.912692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:58.929164 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:58.944039 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f1681487-7ed7-4fbd-897f-78cb1e1fc1e8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.187991 May 26 21:30:58.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 251/468] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:58 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:58.972802 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:58.973400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:58.979434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:58.982266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:58.982266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:58.982266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:59.123503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:59.131827 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:59.134022 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:59.135210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5c2807e1-21a0-4626-8646-5e529e36deeb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.166518 May 26 21:30:59.135787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 218/469] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:30:58 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:59.687796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:59.688441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:59.690259 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=74 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:59.698161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:59.698161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:59.698161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:59.698161 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:59.829048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:59.836688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-498a7f56-aac2-4f73-9e1d-3c681d61dd18 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.153435 May 26 21:30:59.837254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 252/470] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:59 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:59.961464 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:59.962071 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:59.968414 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:59.968864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:59.969632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:59.970066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:00.097858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:00.105805 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5f3e055f-a71a-4139-b170-eb98dc75170d tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.148246 May 26 21:31:00.106376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 219/471] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:30:59 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:00.153844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:00.154096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:00.160720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:00.161224 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:00.162020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:00.162454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:00.293635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:00.303485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:00.305645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:00.306807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-97ebb9d1-5952-407e-b6ca-8f6204d2c10e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.157374 May 26 21:31:00.307352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 253/472] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:00 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:31:00.854247 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:00.854765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:00.860811 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:00.861273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:00.862868 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:00.863297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:01.000100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:01.007710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b036e111-8bb4-4386-a1f5-eaa084a140e7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.157998 May 26 21:31:01.008347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 220/473] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:00 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:01.123032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:01.123568 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:01.130121 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:01.130572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:01.131418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:01.132024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:01.261949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:01.269358 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-50117bca-6626-4e5e-bfcc-e72decc45127 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.150286 May 26 21:31:01.269919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 254/474] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:01 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:01.324646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:01.325260 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:01.331201 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:01.331645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:01.332450 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:01.332892 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:01.465235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:01.473624 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:01.475167 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:01.476349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ef172e5f-f8ec-4087-b3f9-cd15a79def4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.155589 May 26 21:31:01.477519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 221/475] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:01 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:02.025197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:02.025805 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:02.031868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:02.032312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:02.033063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:02.033506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:02.161579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:02.169139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d7d1008d-3631-4e8f-b909-55bbe5e1c1d8 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.148387 May 26 21:31:02.169708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 255/476] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:02 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:02.286723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:02.287277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:02.293786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:02.294240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:02.295006 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:02.295440 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:02.426502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:02.435156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b82adcdb-1a0b-43ff-8fe3-3b8113848bc4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.152571 May 26 21:31:02.435879 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 222/477] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:02 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:02.495029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:02.495729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:02.501829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:02.502276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:02.503037 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:02.503478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:02.635704 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:02.644002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:02.645519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:02.646694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a1500467-d94b-4ccf-9ba8-8d34d4464a25 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.156218 May 26 21:31:02.647258 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 256/478] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:02 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:03.186417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:03.187032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:03.193254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:03.193707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:03.194513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:03.194960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:03.329095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:03.337532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c207c00a-ab10-485c-ae1c-b7908e03a701 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.154979 May 26 21:31:03.338110 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 223/479] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:03 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:03.451894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:03.452502 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:03.459086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:03.460134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:03.460284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:03.460721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:03.590057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:03.598420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-99c17908-dcd9-430e-8b8f-cecfc081df8a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.149949 May 26 21:31:03.599105 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 257/480] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:03 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:03.665198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:03.665800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:03.671798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:03.672243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:03.672994 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:03.673427 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:03.799344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:03.808223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:03.809849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:03.810991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dd85773b-b755-416a-87e8-897b296bbd26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.150321 May 26 21:31:03.811548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 224/481] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:03 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:04.354602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:04.355205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:04.361222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:04.361667 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:04.362424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:04.362869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:04.491509 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:04.499659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a658b75b-36e9-42b2-96f5-347f03017d3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.149065 May 26 21:31:04.500256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 258/482] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:04 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:04.614335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:04.614902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:04.621880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:04.622398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:04.623162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:04.623589 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:04.755376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:04.762954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9a69b133-a124-4a04-b76f-ed9a71e6a15b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.152552 May 26 21:31:04.763515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 225/483] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:04 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:04.828978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:04.833912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:04.835548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:04.836034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:04.836792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:04.837229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:04.971553 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:04.978407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:04.980260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:04.981952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-33c6de76-9054-4849-9234-5e44adbe75d1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.156917 May 26 21:31:04.982698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 259/484] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:04 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:05.516861 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:05.517492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:05.523540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:05.524535 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:05.525302 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:05.525731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:05.660465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:05.662683 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:05.666065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:05.667574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:05.668070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:05.668852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:05.669342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:05.681333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-eeac01af-e31e-4136-bd4f-6aab2cbeef82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1264 microversion: 2.1 time: 0.168123 May 26 21:31:05.684903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 226/485] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:05 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:05.714292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:31:05.781612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:05.783215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:05.796076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:05.796798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:05.797639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:05.798019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:05.981879 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:05.989908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7c774b12-3831-4a8f-bdcf-7894107ea44b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.213264 May 26 21:31:05.990585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 227/486] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:05 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:06.004896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:06.005499 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:06.012042 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.012491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.013254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.013689 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.055588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c7cb4e37-05f8-44cd-a6e7-0388fd740dc5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 204 len: 0 microversion: 2.1 time: 0.398166 May 26 21:31:06.056139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 260/487] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:31:05 2022] DELETE /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 21:31:06.064942 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:06.065762 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:06.072549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.073006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.074643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.075153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.153012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:06.161341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:06.162874 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:06.164641 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b21caa5d-1eb5-4e2f-a444-45edb3958adf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.162912 May 26 21:31:06.165494 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 228/488] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:06 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:06.233064 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:06.241493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-90e46777-d994-4852-a82f-455b6402d1b2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1513 microversion: 2.1 time: 0.180981 May 26 21:31:06.242090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 261/489] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:06 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:06.703992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:06.704613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:06.712130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.712424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.713200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.713635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.851120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:06.859710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c70b0557-fb8c-4c85-8c1f-6d66abb031c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1452 microversion: 2.1 time: 0.162844 May 26 21:31:06.860334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 229/490] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:06 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:06.877071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:06.877676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:06.884771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.885215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:06.885975 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:06.886407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.011344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:07.012099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:07.020596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:07.021457 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.022776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:07.023419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.026260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:07.037293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-be201eef-472c-4219-baa5-620696859e10 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1452 microversion: 2.1 time: 0.163779 May 26 21:31:07.051346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 262/491] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:06 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:07.170242 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:07.172444 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:07.178882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c6f87498-bba7-47ff-8c78-c42f2bdea69a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.174800 May 26 21:31:07.183329 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 230/492] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:07 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:07.183473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:07.183988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:07.190693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:07.191372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.192231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:07.192677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.259764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:07.260704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:07.267925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:07.268372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.269132 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:07.269560 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:07.330668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:07.338943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:07.340487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:07.341637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5e7b9f8d-1c55-4a98-b4ff-2517e5582981 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.162489 May 26 21:31:07.342200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 263/493] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:07 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:07.454950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:07.462689 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4723e60e-dff2-4ff0-a5b2-b63001fd5d90 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1513 microversion: 2.1 time: 0.207965 May 26 21:31:07.463270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 231/494] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:07 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:08.195914 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:08.197714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:08.203618 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.204219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.205287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.205825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.341967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:08.349763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-77e851c4-594f-49a3-8961-f6baf74291c8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.157816 May 26 21:31:08.350325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 264/495] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:08 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:08.363810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:08.364523 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:08.370933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.371489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.372365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.373595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.480337 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:08.484844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:08.494278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.496036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.497867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.498372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.639597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:08.652598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:08.655629 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:08.657648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-61bc4336-436f-4f38-8648-c553016a0991 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.302072 May 26 21:31:08.658426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 232/496] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:08 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:08.672238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-28888507-6e4b-4b73-8fa1-1c48f5987a09 req-be0a001e-d4d3-4dd8-9068-39dbb3e450c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "name": "network-vif-plugged", "status": "completed", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:08.682055 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-28888507-6e4b-4b73-8fa1-1c48f5987a09 req-be0a001e-d4d3-4dd8-9068-39dbb3e450c1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:08.682591 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-28888507-6e4b-4b73-8fa1-1c48f5987a09 req-be0a001e-d4d3-4dd8-9068-39dbb3e450c1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:08.709006 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-28888507-6e4b-4b73-8fa1-1c48f5987a09 req-be0a001e-d4d3-4dd8-9068-39dbb3e450c1 service nova] Creating event network-vif-plugged:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:31:08.721589 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-28888507-6e4b-4b73-8fa1-1c48f5987a09 req-be0a001e-d4d3-4dd8-9068-39dbb3e450c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056310 May 26 21:31:08.721589 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 233/497] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:08.755773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:08.765489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-eb85f205-b544-4551-9325-5043c667cd57 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1513 microversion: 2.1 time: 0.288704 May 26 21:31:08.766382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 265/498] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:08 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:09.370120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:09.372164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:09.380123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:09.380584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:09.384936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:09.384936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:09.627948 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:09.636010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c2273357-458b-4af6-9b83-4c683a2f6c8b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.271647 May 26 21:31:09.636588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 234/499] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:09 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:09.676367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:09.676968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:09.683425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:09.683896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:09.684662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:09.685095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:09.784770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:09.785781 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:09.788339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=84 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:09.794798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:09.795369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:09.797068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:09.797321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:09.857331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:09.861343 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:09.866349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:09.868004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:09.869579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bbe4119c-b6ab-4647-8360-5bd794b573ac tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.197425 May 26 21:31:09.870117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 266/500] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:09 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:10.426167 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:10.435614 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ab1bfe7c-e982-4880-8223-c9614f7e03f2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1513 microversion: 2.1 time: 0.656417 May 26 21:31:10.445249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 235/501] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:09 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1513 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:10.653806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:10.654581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:10.661867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:10.662396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:10.663194 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:10.663643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:10.712011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-8f9a3be1-e343-4183-a4a9-c6cd25580628 req-2f8c976a-50a1-4b31-96da-2dba7566769f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b289518-380f-4d2c-b761-5ac6bf9e6ab4", "name": "network-vif-deleted", "tag": "c02aef43-e795-46ef-a72d-a1fe076e05d9"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:10.728770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-8f9a3be1-e343-4183-a4a9-c6cd25580628 req-2f8c976a-50a1-4b31-96da-2dba7566769f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:10.738241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-8f9a3be1-e343-4183-a4a9-c6cd25580628 req-2f8c976a-50a1-4b31-96da-2dba7566769f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:10.756210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-8f9a3be1-e343-4183-a4a9-c6cd25580628 req-2f8c976a-50a1-4b31-96da-2dba7566769f service nova] Creating event network-vif-deleted:c02aef43-e795-46ef-a72d-a1fe076e05d9 for instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 on hv-cinder-82880 May 26 21:31:10.761864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-8f9a3be1-e343-4183-a4a9-c6cd25580628 req-2f8c976a-50a1-4b31-96da-2dba7566769f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053714 May 26 21:31:10.767104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 236/502] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:31:10.837016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:10.847072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d5ea3a2d-7fc6-4d84-a9ee-e7514fb20ac3 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.197515 May 26 21:31:10.847716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 267/503] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:10 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:10.888621 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:10.889443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:10.896349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:10.896825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:10.897683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:10.898360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:11.096734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:11.107087 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:11.108650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:11.110091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b2a33ccc-4956-4618-89a2-095a7c49c0be tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.226430 May 26 21:31:11.110663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 237/504] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:10 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:11.453986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:11.454373 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:11.462032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:11.462484 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:11.463425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:11.463978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:11.535989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:11.545565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dbf2bc89-c2de-4111-8b2a-f344733838d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1471 microversion: 2.1 time: 0.096724 May 26 21:31:11.546696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 268/505] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:11 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:11.864852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:11.865569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:11.872889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:11.873352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:11.874116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:11.874547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.015271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:12.023232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-03c1de16-e71e-4c86-8d53-9b4578292bdd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.161963 May 26 21:31:12.024384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 238/506] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:11 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:12.129733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:12.130345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:12.138029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.138493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.139310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.139712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.183194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:12.183815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:12.195227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.195227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.195227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.195227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.227999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0c7a4853-0d49-4cf3-8f7c-74ff929f44b3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/ips" status: 200 len: 149 microversion: 2.1 time: 0.049423 May 26 21:31:12.227999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 239/507] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:31:12 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:12.325144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:12.334825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:12.337236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:12.338574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0265ef6f-d575-4ebf-8eff-2628caba615e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.212841 May 26 21:31:12.339141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 269/508] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:12 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:31:12.563114 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:12.563733 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:12.570237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.570687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.571448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.571935 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.639851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:12.647940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-881b96af-3b45-4a9e-8dbf-730d1d5bfa6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1471 microversion: 2.1 time: 0.088597 May 26 21:31:12.649451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 240/509] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:12 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:12.778318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-af52c0a9-271c-40b0-be39-355d0ce0c5fc req-27c77b5a-9558-4902-bc91-1b1f298f844d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e2b4ade-df77-4c06-bfc0-2a510bfe37d5", "tag": "1faef2ef-eecc-4157-ac0a-913c45525b24"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:12.786662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-af52c0a9-271c-40b0-be39-355d0ce0c5fc req-27c77b5a-9558-4902-bc91-1b1f298f844d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:12.787111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-af52c0a9-271c-40b0-be39-355d0ce0c5fc req-27c77b5a-9558-4902-bc91-1b1f298f844d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:12.798657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-af52c0a9-271c-40b0-be39-355d0ce0c5fc req-27c77b5a-9558-4902-bc91-1b1f298f844d service nova] Creating event network-changed:1faef2ef-eecc-4157-ac0a-913c45525b24 for instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 on hv-cinder-82880 May 26 21:31:12.804493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-af52c0a9-271c-40b0-be39-355d0ce0c5fc req-27c77b5a-9558-4902-bc91-1b1f298f844d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029842 May 26 21:31:12.805122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 270/510] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:13.039894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:13.040516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:13.047348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:13.049769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:13.049769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:13.049769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:13.178101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:13.185575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d8a3986d-a91c-46e7-a925-bacda292ffb6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.149542 May 26 21:31:13.186137 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 241/511] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:13 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:13.357844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:13.358464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:13.364759 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:13.365217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:13.365985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:13.366427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:13.497867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:13.506207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:13.507761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:13.509612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-af676521-8867-49d4-ab76-401572fa5098 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.156539 May 26 21:31:13.510170 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 271/512] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:13 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:13.665960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:13.666575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:13.672702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:13.673153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:13.673919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:13.674408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:13.737899 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:13.745940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-03ed4f82-33cd-4f7a-ac8a-bb21cac92467 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1304 microversion: 2.1 time: 0.084475 May 26 21:31:13.746509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 242/513] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:13 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:14.202309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:14.202908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:14.208845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:14.209285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:14.210107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:14.210542 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:14.339662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:14.346999 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8f3f024c-45aa-44a4-bd24-220418d0eb1b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.148524 May 26 21:31:14.347555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 272/514] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:14 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:14.528074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:14.528663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:14.535579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:14.535988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:14.536777 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:14.537205 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:14.664837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:14.673243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:14.674755 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:14.676203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1d82eaf1-447b-45ea-be1f-3c331db82618 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.151838 May 26 21:31:14.676754 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 243/515] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:14 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:14.762342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:14.762937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:14.769356 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:14.769801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:14.770551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:14.771223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:14.831430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:14.839693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2425c35c-62bf-4911-a6a3-c1fcc613cb55 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1304 microversion: 2.1 time: 0.081119 May 26 21:31:14.840473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 273/516] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:14 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:15.364148 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:15.364759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:15.370820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:15.371269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:15.372065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:15.372506 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:15.498963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:15.506434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c273ad68-4ef0-4669-b13d-ed2812c622fd tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.146102 May 26 21:31:15.507004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 244/517] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:15 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:15.694779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:15.696072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:15.702275 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:15.702658 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:15.703429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:15.703893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:15.838143 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:15.846765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:15.848478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:15.849722 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-afe868c8-2868-4287-b387-b51588c1bc7a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.158859 May 26 21:31:15.851565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 274/518] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:15 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:15.856799 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:15.857474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:15.864292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:15.864736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:15.865508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:15.865936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:15.933611 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:15.941388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1fbaf971-34e5-44d0-b76a-0abb8c3d1220 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1304 microversion: 2.1 time: 0.088526 May 26 21:31:15.941955 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 245/519] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:15 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:16.523603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:16.524776 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:16.530779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:16.531231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:16.532020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:16.532459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:16.662933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:16.670920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-521ef2cb-305f-4867-ae49-f1c7cc2472fb tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1358 microversion: 2.1 time: 0.151166 May 26 21:31:16.671621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 275/520] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:16 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:16.868178 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:16.868778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:16.875200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:16.875639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:16.876424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:16.876853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:16.958236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:16.959062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:16.966559 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:16.967108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:16.968188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:16.968542 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.001813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.002265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.002717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lazy-loading 'fault' on Instance uuid 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:31:17.024082 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:17.032204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:17.033703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:17.034851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9624678f-6b85-46da-b295-80eb4e9db151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.170629 May 26 21:31:17.035404 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 246/521] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:16 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:17.043687 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:17.051585 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6cd26cb1-29c5-4ac5-b080-9c71db2f387a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 200 len: 1309 microversion: 2.1 time: 0.097295 May 26 21:31:17.052179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 276/522] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:16 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:17.286531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1def128d-7755-4ccb-89aa-8ab3743dae03"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:17.287675 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:17.293717 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.297744 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.297744 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.297744 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.687498 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:17.688153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:17.694944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.695391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.696228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.696675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.823507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:17.831335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8a503def-f7d8-40f9-b485-ac7a80459310 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1547 microversion: 2.1 time: 0.147638 May 26 21:31:17.832124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 277/523] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:17 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:17.849137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:17.849743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:17.856637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.857087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:17.857851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:17.858284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.036754 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:18.054066 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b83b84cb-5316-4c41-9d83-869e63b14470 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1547 microversion: 2.1 time: 0.206454 May 26 21:31:18.054066 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 278/524] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:17 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:18.058027 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:18.066324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:18.077276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.077276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.077276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.077276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.230680 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:18.238869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:18.240444 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:18.241611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2a82ef09-122c-415d-9f8a-263e20cb5041 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.187438 May 26 21:31:18.242176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 279/525] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:18 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:18.246832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:18.250338 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:18.251101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Searching by: {'deleted': False, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8'} {{(pid=118557) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 21:31:18.257831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.258280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.259620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.260105 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.349772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.multi_cell_list [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118557) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 21:31:18.450399 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-22b6d2a9-0056-46fa-9bda-ceca424be4e4 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207163 May 26 21:31:18.450985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 280/526] 10.222.0.42 () {58 vars in 1124 bytes} [Thu May 26 21:31:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:18.455427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:18.456066 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 1b289518-380f-4d2c-b761-5ac6bf9e6ab4] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:18.462655 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.463104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.463894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.464333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.477623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] HTTP exception thrown: Instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 could not be found. May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Request method failure captured: May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 HTTP/1.1 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_EGLXBSundPAxxqxXCjDKcJgE-qlEcTiF-x4nukWHWrVWsmDHJrZcc9-wLfZZ-UkwI6zhsZ82o9GU-6HItxVq4BwlMW0ad0HZTXjGAhVf_t3hqKp4J8zV8kd0bQPPGRm8ALcG9HXX7JzBus4A6syP70GEfrwUPuqwDIHQBGz4w8yF8 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 0a97f689104e4884b6e30b0c8606b513 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesSnapshotTestJSON-559899765 May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:31:18.482610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0a97f689104e4884b6e30b0c8606b513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0a97f689104e4884b6e30b0c8606b513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a97f689104e4884b6e30b0c8606b513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a97f689104e4884b6e30b0c8606b513"}]}] May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesSnapshotTestJSON-559899765 May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 0a97f689104e4884b6e30b0c8606b513 May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-559899765 May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesSnapshotTestJSON-559899765-project May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6a658b1951a9426d94341940d87b5f95 May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesSnapshotTestJSON-559899765-project May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 could not be found. May 26 21:31:18.484195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '1b289518-380f-4d2c-b761-5ac6bf9e6ab4'} May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 could not be found. May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:31:18.485056 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 could not be found. May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 could not be found. May 26 21:31:18.486333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:31:18.487717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Returning 404 to user: Instance 1b289518-380f-4d2c-b761-5ac6bf9e6ab4 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:31:18.487717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3e0b7c8e-2b9a-4a63-b8e6-b6c9810b6b52 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4" status: 404 len: 111 microversion: 2.1 time: 0.028772 May 26 21:31:18.487717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 281/527] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:18 2022] GET /compute/v2.1/servers/1b289518-380f-4d2c-b761-5ac6bf9e6ab4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:31:18.487717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:18.487717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:18.492664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.493620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.494509 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:18.495130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:18.636111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:18.643608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-46f92154-2034-4c39-9fe6-8af3c93c7039 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1547 microversion: 2.1 time: 0.161479 May 26 21:31:18.648348 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 282/528] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:18 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:18.735930 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:18.875195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-972519c4-161f-4621-b94a-36407600b49c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.592614 May 26 21:31:18.875866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 247/529] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:31:17 2022] POST /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments => generated 194 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:19.260177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:19.260789 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:19.267290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:19.267725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:19.268519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:19.268950 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:19.396067 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:19.404674 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:19.406186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:19.407323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c301701d-39ae-4f6c-95fb-77fac51bb29a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.151217 May 26 21:31:19.407897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 283/530] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:19 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:20.427406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:20.428128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:20.435229 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:20.435683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:20.436474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:20.436916 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:20.614498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:20.623195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:20.624743 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:20.625880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4ab7213c-ed94-469e-816e-bd380c3a774b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.204190 May 26 21:31:20.626435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 248/531] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:20 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:21.643507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:21.644158 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:21.651163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:21.651608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:21.652398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:21.652833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:21.655429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:21.782987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:21.790921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:21.793081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:21.794216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-961ef534-bb22-4cc2-9991-f31a7544c2de tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.154557 May 26 21:31:21.794772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 284/532] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:21 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:22.813317 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:22.813957 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:22.820789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:22.821237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:22.821999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:22.822444 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:22.959314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:22.967734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:22.969272 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:22.970430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b5708880-8d84-4565-a8cc-d586b00d5f4d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.161082 May 26 21:31:22.970988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 249/533] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:22 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:23.988912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:23.989511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:23.996175 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:23.996619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:23.997371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:23.997804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:24.123072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:24.130977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:24.132560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:24.133837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f00ee476-2c90-465d-b0e4-e6499766e360 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.148645 May 26 21:31:24.134399 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 285/534] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:23 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:25.152610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:25.153219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:25.160103 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:25.160583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:25.161360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:25.161801 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:25.298816 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:25.307665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:25.309393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:25.310630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-012a62aa-4460-447e-8d46-e10afa057635 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.162024 May 26 21:31:25.311276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 250/535] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:25 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:25.359887 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-4f43b2e8-69fa-4d8b-8936-aae050df5d8b req-08ba7e75-de36-4c66-aee3-b2c81bc5394a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "name": "network-vif-plugged", "status": "completed", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:25.369136 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-4f43b2e8-69fa-4d8b-8936-aae050df5d8b req-08ba7e75-de36-4c66-aee3-b2c81bc5394a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:25.369604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-4f43b2e8-69fa-4d8b-8936-aae050df5d8b req-08ba7e75-de36-4c66-aee3-b2c81bc5394a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:25.382272 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-4f43b2e8-69fa-4d8b-8936-aae050df5d8b req-08ba7e75-de36-4c66-aee3-b2c81bc5394a service nova] Creating event network-vif-plugged:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:31:25.387298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-4f43b2e8-69fa-4d8b-8936-aae050df5d8b req-08ba7e75-de36-4c66-aee3-b2c81bc5394a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 May 26 21:31:25.387915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 286/536] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:26.331724 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:26.332421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:26.338818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:26.339265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:26.340062 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:26.340503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:26.472951 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:26.478661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:26.480747 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:26.481914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b0442ea8-9683-4657-8d22-623eef392348 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.154078 May 26 21:31:26.482476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 251/537] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:26 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:27.502158 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:27.502631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:27.508966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:27.509400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:27.511061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:27.511306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:27.641410 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:27.649459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:27.650958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:27.652202 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8b1ef61e-128e-481a-9c76-4ae4c0089fe6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.155250 May 26 21:31:27.652711 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 287/538] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:27 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:28.670116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:28.670646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:28.677418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:28.677862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:28.678619 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:28.679054 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:28.808438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:28.816503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:28.818009 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:28.819151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-12b15005-636c-4158-83d4-7b84bc94549e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.153054 May 26 21:31:28.819727 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 252/539] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:28 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:29.838288 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:29.839394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:29.841436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:29.842594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:29.847332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:29.847787 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:29.848587 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:29.850595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:30.205230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:30.213374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:30.215424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:30.216602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ed023100-51fb-4255-86bc-721ec5fa0b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.382380 May 26 21:31:30.217226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 288/540] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:29 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:31.235360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:31.236023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:31.242500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:31.242950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:31.243713 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:31.244179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:31.372579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:31.380448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:31.382000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:31.383154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e95bf7e3-6685-4077-9464-cf8a0d3de11f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1744 microversion: 2.20 time: 0.152496 May 26 21:31:31.383721 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 253/541] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:31 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:32.404893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:32.405817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:32.413948 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:32.414525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:32.415515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:32.416170 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:32.526334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0192dd33-e41b-40b2-932f-eb013b5395c9"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:32.527926 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:32.534168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:32.534619 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:32.535481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:32.535953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:32.558291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:32.570315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:32.571005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:32.571924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-973455d6-a536-4079-9346-4cad8f5bb062 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.174228 May 26 21:31:32.583560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 289/542] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:32 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:33.592285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:33.593069 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:33.603235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:33.604016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:33.604941 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:33.605514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:33.771290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:33.783582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:33.785451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:33.786997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0cd6eb51-fc73-4fa7-aadd-e44ba2a68274 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.199568 May 26 21:31:33.787729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 290/543] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:33 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:31:33.853381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a6e47c77-cf7d-4742-ace9-fd9cfdb06f6b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.330667 May 26 21:31:33.854682 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 254/544] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:31:32 2022] POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:31:34.808735 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:34.810189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:34.820002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:34.820650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:34.822581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:34.823145 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:35.153931 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:35.158341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:35.160167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:35.161411 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b8b86c85-7639-45a5-b14f-f7801f6592e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.357732 May 26 21:31:35.162268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 291/545] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:34 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:36.180046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:36.180783 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:36.188691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:36.189148 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:36.190123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:36.190934 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:36.328780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:36.336833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:36.338363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:36.339526 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8986d5d7-ebf0-48ef-a2c9-fe838f28d253 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.164412 May 26 21:31:36.340110 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 255/546] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:36 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:37.368554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:37.372961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:37.384704 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:37.387016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:37.391897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:37.392646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:37.592962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:37.603657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:37.605409 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:37.606743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-30aa7633-701b-4b64-b255-baf6ac94f2ba tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.251668 May 26 21:31:37.607404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 292/547] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:37 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:38.637958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:38.637958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:38.661572 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:38.662019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:38.662803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:38.663245 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:38.903834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:38.927646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:38.933288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:38.937910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a1fa9fe7-58bd-4667-b13e-528b89b0b33f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.317487 May 26 21:31:38.939192 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 256/548] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:38 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:39.827191 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-451946276", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "networks": [{"uuid": "5700046f-4b5a-4ad3-a1d7-379e90370a51"}]}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:39.939586 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] validate_networks() for [('5700046f-4b5a-4ad3-a1d7-379e90370a51', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:31:39.992687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:39.994128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:40.026567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:40.036643 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:40.040809 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:40.041585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:40.227325 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:40.236905 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:40.238471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:40.239670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f46a9877-b99f-4d45-8c2a-12164be02e65 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.266012 May 26 21:31:40.240261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 257/549] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:39 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:31:40.455629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:31:40.456182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:31:40.457146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:31:40.457549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:31:40.457958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:31:40.467945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:40.468397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:40.469672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:40.470048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:40.489620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Getting quotas for project 0a97f689104e4884b6e30b0c8606b513. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:31:40.494019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Getting quotas for user 6a658b1951a9426d94341940d87b5f95 and project 0a97f689104e4884b6e30b0c8606b513. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:31:40.507356 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:31:40.510048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:31:40.711018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c3b0819e-b397-48e8-91ed-cdc8838608d3 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888412 May 26 21:31:40.712241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 293/550] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:31:40.726926 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2217ad8f-e167-41c7-a17e-c1cc7a58e495 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:40.731148 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2217ad8f-e167-41c7-a17e-c1cc7a58e495 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:40.738714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=46 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:40.829104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2217ad8f-e167-41c7-a17e-c1cc7a58e495 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:40.838084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2217ad8f-e167-41c7-a17e-c1cc7a58e495 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1218 microversion: 2.1 time: 0.115991 May 26 21:31:40.841932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 258/551] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:40 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:41.263421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:41.264745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:41.284696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:41.285363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:41.286462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:41.287133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:41.600544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:41.612195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:41.615312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:41.617951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e71d8709-c886-4fb6-9273-d325b0c73b43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.363641 May 26 21:31:41.639451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 294/552] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:41 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:41.778961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bfcda061-c0d3-476d-8364-11a03001f8bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: .version_select at 0x7f7bc4d4b9d0>, body: {"keypair": {"name": "tempest-keypair-619979787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOLPS7RUHsR3XN0NlGkUvKhfx9U3vMXbJs0pR1oZBFv2N2cnFQf6CYvZYCQSwerXuDKv2wfLXc9l8OjDW8UcaPz05SMtie/sGZad1o3Q6diISqmBwYgrHuD4oKfeuY82A=="}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:41.818125 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-bfcda061-c0d3-476d-8364-11a03001f8bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:31:41.833046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-bfcda061-c0d3-476d-8364-11a03001f8bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:31:41.870356 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:41.877235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:41.889687 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:41.890406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:41.891355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:41.891985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:41.940409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bfcda061-c0d3-476d-8364-11a03001f8bc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167585 May 26 21:31:41.941328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 259/553] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:31:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:42.068232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:42.077962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0c6f08ac-c2e3-4a5c-ae57-292280a834ec tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1222 microversion: 2.1 time: 0.217527 May 26 21:31:42.084019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 295/554] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:41 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:42.656380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:42.657160 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:42.692171 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:42.709102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:42.715814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:42.722294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:43.046368 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:43.057038 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:43.066101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:43.067407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-be9a9d4e-5ee3-4ef9-923f-b2369ffbfed8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.431638 May 26 21:31:43.071070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 260/555] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:42 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:43.107357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:43.108011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:43.122718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:43.124382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:43.125825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:43.127789 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:43.220328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:43.231714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-818ba547-ccf0-4730-b547-bbcae8a53c06 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1270 microversion: 2.1 time: 0.129855 May 26 21:31:43.231714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 296/556] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:43 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:44.093464 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:44.094082 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:44.114051 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:44.114775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:44.115773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:44.118260 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:44.262213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:44.263551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:44.277516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:44.278395 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:44.279235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:44.285292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:44.444902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:44.453904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9ce4be6b-217b-4f08-832c-a84d6886bce4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1276 microversion: 2.1 time: 0.208156 May 26 21:31:44.456124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 297/557] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:44 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:45.041361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:45.059516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:45.065219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:45.066987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1bc8cfa8-aa99-48e1-b24b-ace42ade0653 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.978137 May 26 21:31:45.069998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 261/558] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:44 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:45.475807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:45.476535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:45.492876 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:45.493331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:45.494154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:45.494594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:45.593013 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:45.601101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-321c7945-863f-40ec-802b-672567dbd383 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1276 microversion: 2.1 time: 0.132309 May 26 21:31:45.611461 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 298/559] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:45 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:45.955303 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-113375885", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e423d8c6-f848-40d6-99bb-c61a958058f7"}], "security_groups": [{"name": "tempest-securitygroup--1490982445"}], "key_name": "tempest-keypair-619979787", "user_data": "}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:46.086580 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:46.087542 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:46.101103 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:46.103428 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:46.105676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:46.108172 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:46.424466 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:46.424799 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] validate_networks() for [('e423d8c6-f848-40d6-99bb-c61a958058f7', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:31:46.443470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:46.447584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:46.449514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d86a0e92-44c4-476f-86e8-7cbd09e83956 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.367394 May 26 21:31:46.452094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 299/560] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:46 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:31:46.630651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:46.630651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:46.630651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:46.630651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:46.631469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:46.631469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:46.776266 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:46.790394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-572bb476-fac2-4964-a4b2-0b94105b13d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.175815 May 26 21:31:46.802851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 300/561] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:46 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:47.006751 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:31:47.007203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:31:47.007646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:31:47.008180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:31:47.008512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:31:47.018771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:47.019537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:47.020594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:47.021448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:47.042669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:31:47.047678 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:31:47.060492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:31:47.062765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:31:47.253035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-13d2a254-cd6d-4c23-a4f7-e9c88a580af4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.302053 May 26 21:31:47.254500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 262/562] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:31:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:31:47.265698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2423ce89-efdd-4e71-b7fd-c1572ec47b7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:47.266578 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2423ce89-efdd-4e71-b7fd-c1572ec47b7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:47.333084 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2423ce89-efdd-4e71-b7fd-c1572ec47b7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:47.340228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2423ce89-efdd-4e71-b7fd-c1572ec47b7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1240 microversion: 2.1 time: 0.080007 May 26 21:31:47.342502 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 301/563] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:47 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:47.474383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:47.482608 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:47.514928 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:47.520897 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:47.522937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:47.524100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:47.798404 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:47.811287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:47.812653 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:47.825422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:47.829414 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:47.831684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bbe83197-254f-4c6e-8f48-0e202939715d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.364252 May 26 21:31:47.832550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 263/564] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:47 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:47.853117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:47.853645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:47.854818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:47.855840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:48.179410 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:48.192368 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7aaaf46a-f0a6-443f-93cf-6fb040322d44 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.381881 May 26 21:31:48.216025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 302/565] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:47 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:48.365748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-78f004ce-2370-4384-b250-36ed225858be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:48.367121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-78f004ce-2370-4384-b250-36ed225858be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:48.555193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-78f004ce-2370-4384-b250-36ed225858be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:48.570780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-78f004ce-2370-4384-b250-36ed225858be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1240 microversion: 2.1 time: 0.214976 May 26 21:31:48.576880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 264/566] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:48 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1240 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:48.731713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-24f6c742-eb95-4ed0-b212-26ee57f82694 req-ec1f1a18-25d7-4b2f-87a9-e6bae737a7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850b5395-31f3-43e6-a549-fa9c33e66b7a", "tag": "c5f69ca6-d120-49a3-a890-77e4b7429ad9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:48.740278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-24f6c742-eb95-4ed0-b212-26ee57f82694 req-ec1f1a18-25d7-4b2f-87a9-e6bae737a7f1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:48.740721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-24f6c742-eb95-4ed0-b212-26ee57f82694 req-ec1f1a18-25d7-4b2f-87a9-e6bae737a7f1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:48.759865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:48.786659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-24f6c742-eb95-4ed0-b212-26ee57f82694 req-ec1f1a18-25d7-4b2f-87a9-e6bae737a7f1 service nova] Creating event network-changed:c5f69ca6-d120-49a3-a890-77e4b7429ad9 for instance 850b5395-31f3-43e6-a549-fa9c33e66b7a on hv-cinder-82880 May 26 21:31:48.812745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-24f6c742-eb95-4ed0-b212-26ee57f82694 req-ec1f1a18-25d7-4b2f-87a9-e6bae737a7f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084893 May 26 21:31:48.815131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 303/567] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:48.860645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:48.860645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:48.867949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:48.868402 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:48.870580 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:48.871019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:49.172610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:49.182325 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:49.184409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:49.185848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ed9f7244-0c9e-40bf-9685-704249773cc2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.340200 May 26 21:31:49.186556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 265/568] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:48 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:49.222079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:49.222849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:49.234929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:49.234929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:49.234929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:49.234929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:49.467248 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:49.478906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4538e3eb-1bc4-4b62-a2de-5515606c3e6c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.259907 May 26 21:31:49.478906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 304/569] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:49 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:49.603438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:49.606827 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:49.637864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:49.638709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:49.647001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:49.647630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:49.764072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:49.767014 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:49.774855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-21a68dca-2548-456a-8975-95e0652fd102 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1292 microversion: 2.1 time: 0.182487 May 26 21:31:49.775498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 266/570] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:49 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:50.209319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:50.211071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:50.232861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.233329 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.234135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.234582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.411089 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:50.421030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:50.423489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:50.425213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-326e80f2-7b1d-4510-8513-b2a6669520fd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1739 microversion: 2.20 time: 0.222560 May 26 21:31:50.426403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 305/571] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:50 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:50.498232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:50.499008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:50.508399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.509204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.510437 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.510982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.633094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:50.634815 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:50.636041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:50.642204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.642874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.643718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.644118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.852802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:50.862615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3401439b-911b-41f8-befc-b60249bc02a2 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1593 microversion: 2.1 time: 0.232969 May 26 21:31:50.864051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 306/572] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:50 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1593 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:50.870169 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:50.874516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:50.879270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.880057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.881164 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:50.881772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:50.964137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:50.982362 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ff78a29c-4000-4a1b-9832-2d9a23d710c5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1292 microversion: 2.1 time: 0.113409 May 26 21:31:50.984837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 307/573] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:50 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:51.339418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:51.358989 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-39174682-42ea-4a65-8812-0bbdf4a4839b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.866324 May 26 21:31:51.369767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 267/574] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:50 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:51.459135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:51.460537 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:51.470951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:51.471924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:51.473850 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:51.474383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:51.756225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:51.771526 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:51.773669 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:51.774552 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-65155ced-cdf3-4b65-bdee-f6c55718f613 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1721 microversion: 2.20 time: 0.328593 May 26 21:31:51.779946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 308/575] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:51 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:52.001432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:52.002043 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:52.018368 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:52.018825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:52.019627 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:52.020098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:52.181364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:52.208020 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d276cae9-7991-4539-914c-d3fcb8aa2bf0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1298 microversion: 2.1 time: 0.210190 May 26 21:31:52.209932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 268/576] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:51 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:52.386424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:52.387932 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:52.432005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:52.432465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:52.433255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:52.433687 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:52.679761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:52.688486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a49b142e-b299-499b-b1ad-0dbb04bb60a1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.315372 May 26 21:31:52.713935 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 309/577] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:52 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:52.798789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:52.799414 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:52.808561 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:52.809568 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:52.819009 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:52.819930 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:53.230414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:53.233616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:53.243543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:53.248482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:53.249525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:53.250162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:53.283304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:53.292272 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:53.299414 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:53.303113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5c2bcce2-7d23-40d9-8336-187f538487cd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1721 microversion: 2.20 time: 0.508644 May 26 21:31:53.304839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 269/578] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:52 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1721 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:53.599788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-f4f5aedb-f7f6-46cc-b92a-b678aae22009 req-0026ab9c-b5b9-4664-ad78-a3e4ee42e8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "name": "network-vif-unplugged", "status": "completed", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:53.608788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f4f5aedb-f7f6-46cc-b92a-b678aae22009 req-0026ab9c-b5b9-4664-ad78-a3e4ee42e8cb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:53.609231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f4f5aedb-f7f6-46cc-b92a-b678aae22009 req-0026ab9c-b5b9-4664-ad78-a3e4ee42e8cb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:53.622469 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-f4f5aedb-f7f6-46cc-b92a-b678aae22009 req-0026ab9c-b5b9-4664-ad78-a3e4ee42e8cb service nova] Creating event network-vif-unplugged:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:31:53.629225 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-f4f5aedb-f7f6-46cc-b92a-b678aae22009 req-0026ab9c-b5b9-4664-ad78-a3e4ee42e8cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033113 May 26 21:31:53.630044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 270/579] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:31:53.715585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:53.716551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:53.723229 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:53.723910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:53.730304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:53.730304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:53.864627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:53.873489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7898a951-96c3-4237-899d-70f5a4313a8c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.649242 May 26 21:31:53.884122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 310/580] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:53 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:54.148412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:54.157067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-93e2efce-b408-42cb-bb89-01fca84a23a2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.445774 May 26 21:31:54.167136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 271/581] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:53 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:54.324071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:54.324764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:54.331221 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:54.332009 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:54.333394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:54.333846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:54.534884 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:54.545196 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:54.547052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:54.548734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5ea8729e-10b9-42cd-bfe2-ee9c46901884 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1721 microversion: 2.20 time: 0.229218 May 26 21:31:54.550593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 311/582] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:54 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:54.736857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-f1829888-ad06-4100-815c-6f8d8be14bc3 req-3341defb-d024-4e47-bbc2-c24dfdb28996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:54.749398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f1829888-ad06-4100-815c-6f8d8be14bc3 req-3341defb-d024-4e47-bbc2-c24dfdb28996 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:54.754387 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f1829888-ad06-4100-815c-6f8d8be14bc3 req-3341defb-d024-4e47-bbc2-c24dfdb28996 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:54.768979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-f1829888-ad06-4100-815c-6f8d8be14bc3 req-3341defb-d024-4e47-bbc2-c24dfdb28996 service nova] Creating event network-changed:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:31:54.779282 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-f1829888-ad06-4100-815c-6f8d8be14bc3 req-3341defb-d024-4e47-bbc2-c24dfdb28996 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046388 May 26 21:31:54.780863 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 272/583] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:54.890469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:54.891222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:54.903594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:54.908244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:54.911912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:54.916921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:55.175199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:55.176341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:55.194793 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:55.199063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:55.200094 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:55.202011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:55.635018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:55.648662 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c3c67d7d-8c70-49e2-848b-dcc35559fd49 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.476523 May 26 21:31:55.650542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 273/584] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:55 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:55.661231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-b4cd7c15-5f9f-4a1d-8c36-10fb88f3ce29 req-57c7be19-ffd2-48ca-baf7-c847e882459b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47b8242-7a18-4ea5-b647-3ac7c275bdab", "tag": "3ee57c28-7886-4588-b610-9158fcb5e1b2"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:55.678040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-b4cd7c15-5f9f-4a1d-8c36-10fb88f3ce29 req-57c7be19-ffd2-48ca-baf7-c847e882459b service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:55.678487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-b4cd7c15-5f9f-4a1d-8c36-10fb88f3ce29 req-57c7be19-ffd2-48ca-baf7-c847e882459b service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:55.716833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-b4cd7c15-5f9f-4a1d-8c36-10fb88f3ce29 req-57c7be19-ffd2-48ca-baf7-c847e882459b service nova] Creating event network-changed:3ee57c28-7886-4588-b610-9158fcb5e1b2 for instance f47b8242-7a18-4ea5-b647-3ac7c275bdab on hv-cinder-82880 May 26 21:31:55.727042 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-b4cd7c15-5f9f-4a1d-8c36-10fb88f3ce29 req-57c7be19-ffd2-48ca-baf7-c847e882459b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075100 May 26 21:31:55.727912 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 274/585] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:55.734184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:55.735260 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:55.742659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:55.743329 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:55.744325 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:55.745102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:55.955987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:55.968098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-10396b86-4fa7-4e41-86c5-52197fdcfd9b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 1.079326 May 26 21:31:55.970243 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 312/586] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:54 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:55.991292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:55.999920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:56.001455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:56.009609 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9cb3bda2-5a2f-498e-89bd-460947df22e5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1721 microversion: 2.20 time: 0.280333 May 26 21:31:56.010210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 275/587] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:55 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:56.667182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:56.667809 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:56.675545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:56.676027 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:56.677047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:56.677420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:56.906274 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:56.920888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6ddd5216-91de-4371-aebd-712b79197bb9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.257509 May 26 21:31:56.921495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 313/588] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:56 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:56.986555 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:56.987166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:56.994736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:56.995185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:56.996029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:56.997047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:57.030525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:57.031837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:57.039195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:57.042297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:57.048063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:57.049226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:57.049891 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:57.294625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:57.303915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0bd09846-c084-4a1b-97e1-3a4fa3c86e05 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.321075 May 26 21:31:57.305130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 276/589] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:56 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:57.340028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=8 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:57.385446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:57.403404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:57.406369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:57.408744 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6d78f394-de01-40f2-a7fb-cbdc6bd83f79 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1721 microversion: 2.20 time: 0.382687 May 26 21:31:57.409494 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 314/590] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:57 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:31:57.946378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:57.948403 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:57.975347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:57.975347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:57.975347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:57.975347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.216027 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8a735c47-7521-47d2-8b0e-b6f99c89befa tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Action: 'create', calling method: .version_select at 0x7f7bc5560790>, body: {"keypair": {"name": "tempest-TestShelveInstance-854379751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQC5sjNzdMhP1MN3qmCiw2U/byEcOJDvszwY/1QXZBMSSi5/mw5/hQEqGy7ECmb1pH1Gcjdx1v9C5SBb2oX4/6VhSqJMKBQbUfCHr+iPRSeET5CYp8JuLejGv/tKpKngQ=="}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:58.217840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:58.225844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b604fd93-0b05-4e4c-8a4b-7a979b5b25bf tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.289937 May 26 21:31:58.235406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 277/591] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:57 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:58.237286 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-8a735c47-7521-47d2-8b0e-b6f99c89befa tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Getting quotas for project 77c3cd3a54424befb4b424e6de1f7870. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:31:58.244371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-8a735c47-7521-47d2-8b0e-b6f99c89befa tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Getting quotas for user 38166757db224367bb8208f6366a4184 and project 77c3cd3a54424befb4b424e6de1f7870. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:31:58.321694 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:58.322315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:58.323364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8a735c47-7521-47d2-8b0e-b6f99c89befa tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.295684 May 26 21:31:58.324219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 315/592] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:31:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:58.329314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.331912 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.332800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.333257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.428212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:58.429048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:58.447771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.448368 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.449148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.450147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.561249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=14 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:58.647312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:58.658596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0051158f-f3d7-49e5-b815-19f7766a1d49 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.340709 May 26 21:31:58.660038 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 278/593] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:58 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:31:58.674292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1439677229"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:58.674833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:58.687599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.690344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.690344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.690344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.699855 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:58.712501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:58.714190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:58.715664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c3533013-ad7b-4b36-80f0-cde364c8446a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1724 microversion: 2.20 time: 0.291912 May 26 21:31:58.716321 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 316/594] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:31:58 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:31:58.734222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceffa45c-1a64-4afe-86c6-a8c240d01f6a"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:58.735197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:58.741300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.741983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.742734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:58.743163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:58.845372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.network.security_group_api [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Adding security group 7edb3ef7-e7c8-45f8-8c05-f77bb963aaaa to port c738b38d-cc3a-42ab-8d0f-8c9dc892211c May 26 21:31:59.378956 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-05642249-0cd8-4f67-8f27-0483571aea85 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/action" status: 202 len: 0 microversion: 2.1 time: 0.717350 May 26 21:31:59.380838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 279/595] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:31:58 2022] POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:31:59.385885 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:59.386722 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:59.400256 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.401071 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:59.402044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.403273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:59.650677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:59.662720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-234e11e2-4b7a-44b7-811b-c89221d9939a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.280624 May 26 21:31:59.663690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 280/596] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:59 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:59.669716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:59.670562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:59.678437 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.679028 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:59.680009 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.680459 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:59.884063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:31:59.895070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8ada079c-335b-4543-b4ef-a3fc0e9215b9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1640 microversion: 2.1 time: 0.229864 May 26 21:31:59.896246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 281/597] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:59 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1640 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:31:59.915675 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-bb6a7ed0-a07e-4004-9b9c-994f692fe89e req-1a7f736b-f05f-471d-970f-5c14e1fa5abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:31:59.931045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-bb6a7ed0-a07e-4004-9b9c-994f692fe89e req-1a7f736b-f05f-471d-970f-5c14e1fa5abf service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.931990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-bb6a7ed0-a07e-4004-9b9c-994f692fe89e req-1a7f736b-f05f-471d-970f-5c14e1fa5abf service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:59.945262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-bb6a7ed0-a07e-4004-9b9c-994f692fe89e req-1a7f736b-f05f-471d-970f-5c14e1fa5abf service nova] Creating event network-changed:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:31:59.953021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-bb6a7ed0-a07e-4004-9b9c-994f692fe89e req-1a7f736b-f05f-471d-970f-5c14e1fa5abf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040662 May 26 21:31:59.956693 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 282/598] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:31:59.962443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:31:59.964187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:31:59.973195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.973975 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:31:59.974942 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:31:59.975565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.144839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2cedf372-2a3a-4310-a1f4-55f8c6838110 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.415111 May 26 21:32:00.145490 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 317/599] 10.222.0.42 () {62 vars in 1363 bytes} [Thu May 26 21:31:58 2022] POST /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments => generated 188 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:32:00.186772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:00.195294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a5816eb9-6613-4558-a68f-2424964377b1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.237064 May 26 21:32:00.195968 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 283/600] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:31:59 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:00.267243 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:00.267529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:00.270473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:00.274245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:00.274697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.275480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:00.275979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.414304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:00.614707 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-65112cbd-aba4-4ff8-a0eb-dfb3d8760bef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/action" status: 202 len: 0 microversion: 2.20 time: 0.351595 May 26 21:32:00.615583 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 318/601] 10.222.0.42 () {62 vars in 1318 bytes} [Thu May 26 21:32:00 2022] POST /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:32:00.624183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:00.625491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:00.632392 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:00.632966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.633950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:00.634684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.680792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:00.681501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:00.689030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:00.689532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.690309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:00.690849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:00.830966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:00.849095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:00.851521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:00.856112 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a6133e7f-2347-47b6-9936-69e3eda9a2cf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1750 microversion: 2.20 time: 0.232992 May 26 21:32:00.856765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 284/602] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:00 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:00.874746 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:00.886451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9c7bd686-7343-4b69-83a8-47bea5f87cdc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.209885 May 26 21:32:00.888003 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 319/603] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:00 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:01.213173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:01.213803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:01.220979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:01.221433 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:01.222214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:01.222658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:01.385884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:01.397943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-27dada2c-d9e0-4426-b237-4e9a9b55abb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.189000 May 26 21:32:01.401007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 285/604] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:01 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:01.877804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:01.877804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:01.884700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:01.885513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:01.886459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:01.887933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:01.907931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:01.908309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:01.914123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:01.914909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:01.917206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:01.917828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:01.976312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:02.140043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:02.148720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:02.149188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:02.150749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:02.151963 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2d69ae39-704a-493a-ae7d-dcb60a58d894 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1750 microversion: 2.20 time: 0.281458 May 26 21:32:02.153148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 320/605] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:01 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1750 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:02.156974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ca50ab8c-076a-4e59-a04c-64fd1db25e26 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.255872 May 26 21:32:02.157538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 286/606] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:01 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:02.415163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:02.415886 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:02.422395 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:02.422846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:02.423634 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:02.424186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:02.559831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:02.567729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2e059306-4ba3-4434-8d2e-a419a6cf3293 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.156604 May 26 21:32:02.568319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 321/607] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:02 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:03.174076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:03.174729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:03.180092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:03.181241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:03.195152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:03.197146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:03.197772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:03.198749 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:03.199351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:03.199997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:03.202141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:03.205738 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:03.361475 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:03.370621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-94fac14a-e775-4fa1-81c9-2d03280275f7 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.200804 May 26 21:32:03.371201 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 322/608] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:03 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:03.375029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:03.384297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:03.385812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:03.387050 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6e96d88f-5774-4966-a691-74809b59a34b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1750 microversion: 2.20 time: 0.219893 May 26 21:32:03.387603 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 287/609] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:03 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:03.585405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:03.590297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:03.614741 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:03.615546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:03.616377 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:03.616821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:04.103353 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:04.112074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-926cfa77-c236-479d-90a4-ac725240a666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.530665 May 26 21:32:04.114957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 323/610] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:03 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:04.388069 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:04.388623 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:04.395045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:04.395593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:04.400765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:04.400765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:04.406308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:04.407482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:04.417812 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:04.418345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:04.419308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:04.420785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:04.537451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:04.546481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1b3c9037-0a89-4337-a02a-6e8bada3991d tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.162263 May 26 21:32:04.547015 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 288/611] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:04 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:04.560329 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:04.569750 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:04.571268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:04.572462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d738b1ef-950c-4357-98ba-54d08741e7f1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.170703 May 26 21:32:04.573011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 324/612] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:04 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:05.129903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.130390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.136771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.137222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.138004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.138438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.289106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.297393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d1096ccc-21e4-4d2e-a168-9d59ec01b8e5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.171473 May 26 21:32:05.298908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 289/613] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:05 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:05.563270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.564170 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.571053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.571498 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.572421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.572900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.595474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.596260 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.602843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.603291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.604111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.604554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.716284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.725663 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-518557c7-67bf-4171-aa94-7dd34f503987 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.165581 May 26 21:32:05.726277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 325/614] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:05 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:05.891250 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.907271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.908842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.910045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-786776d7-9c25-4b1a-aca0-5ee798164882 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.319206 May 26 21:32:05.910617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 290/615] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:05 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:06.314588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.315192 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.321382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.321831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.322604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.323040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.457454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:06.468771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e6b08b49-7d29-409a-af27-f4bd808698ba tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.157866 May 26 21:32:06.476470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 326/616] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:06 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:06.744226 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.745204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.752042 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.752544 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.753295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.753835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.920549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:06.930527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.931106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d9984907-259f-49d4-84f8-91809eaa31b4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.190877 May 26 21:32:06.931306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.931481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 291/617] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:06 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:06.937791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.938341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.939234 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.939769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:07.076661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:07.086256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:07.087817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:07.088995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-eb8e88af-96f9-4c7d-9892-58d254920af6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.163633 May 26 21:32:07.089590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 327/618] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:06 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:07.489266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:07.489789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:07.496815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:07.496968 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:07.498519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:07.498918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:07.636652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:07.644151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e3ae8eab-ad85-448f-8dd5-d5df9617e3d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.159456 May 26 21:32:07.644781 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 292/619] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:07 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:07.948302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:07.949470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:07.956903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:07.957365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:07.958148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:07.958616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:08.090722 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:08.098780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0bc7a114-32bc-470a-bc69-2cc357689fba tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.154859 May 26 21:32:08.099334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 328/620] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:07 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:08.108534 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:08.120479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:08.120479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:08.120479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:08.120479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:08.120868 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:08.120868 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:08.244767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:08.253263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:08.254771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:08.255933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fcba5389-c56f-4ccf-b02d-6aaf86c76fc3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.152026 May 26 21:32:08.256488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 293/621] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:08 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:08.660848 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:08.661457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:08.663301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:08.668310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:08.676436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:08.676436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:08.676436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:08.803508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:08.811926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6ff654f8-3515-424b-8bc8-22827234b908 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.154852 May 26 21:32:08.812508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 329/622] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:08 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:09.118338 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:09.118886 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:09.126267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:09.126713 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:09.127486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:09.127976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:09.268874 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:09.274392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:09.275008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:09.277003 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1ecc52f2-ff90-454d-86b2-1b00d359c851 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.162632 May 26 21:32:09.277569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 294/623] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:09 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:09.281626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:09.282079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:09.282899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:09.283340 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:09.416936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:09.426545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:09.428185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:09.429370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cef661e8-f671-4df1-8421-570e873209ff tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.158875 May 26 21:32:09.429925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 330/624] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:09 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:09.829707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:09.830339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:09.836498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:09.836935 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:09.837699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:09.838134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:09.968651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:09.976082 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-70439535-2cb6-42f1-bb84-083431542710 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.150900 May 26 21:32:09.976642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 295/625] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:09 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:10.293591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:10.294150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:10.301512 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:10.301966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:10.302756 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:10.303191 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:10.428214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:10.435823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-abac824a-fe0b-4491-a7e5-88000cf293d2 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.146239 May 26 21:32:10.436405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 331/626] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:10 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:10.447597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:10.448257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:10.454650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:10.455119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:10.455892 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:10.456333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:10.588604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:10.597256 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:10.598806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:10.600013 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1469b952-03a6-41c2-8957-19bbe4197039 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.156232 May 26 21:32:10.601108 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 296/627] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:10 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:10.992400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:10.993015 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:10.999028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:10.999472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:11.000268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:11.000703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:11.134258 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:11.141606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-33d22643-9179-48ad-b577-7d6391c4f5f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.153013 May 26 21:32:11.142173 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 332/628] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:10 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:11.452496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:11.453100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:11.460796 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:11.461301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:11.462106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:11.462543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:11.600666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:11.609714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-df5c917c-0b0d-466a-9295-1a42a4f96ede tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.160455 May 26 21:32:11.610291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 297/629] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:11 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:11.618243 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:11.618853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:11.625440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:11.625892 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:11.626661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:11.627096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:11.757979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:11.766248 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:11.767884 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:11.768911 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0cb96484-336c-4f7f-b729-e6e9925467d9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.154553 May 26 21:32:11.769469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 333/630] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:11 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:12.159080 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:12.159610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:12.165693 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.166142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.166927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.167364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.304459 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:12.312033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9519dca0-61e3-4b7a-9cac-16ab92b15802 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.157581 May 26 21:32:12.312593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 298/631] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:12 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:12.626608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:12.627372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:12.638415 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.638863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.639664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.640487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.656864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:12.790090 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:12.790701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:12.802524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.803169 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.803994 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.804675 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.805582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:12.814138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9d9ec64e-0ab6-4f4e-b508-30b6f35a6945 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.191365 May 26 21:32:12.814722 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 334/632] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:12 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:12.941227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-bbcaa438-338c-45b9-8c16-cf41f6d8dc2d req-651f4c80-b735-4f4e-a5ed-f0e885ecbea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850b5395-31f3-43e6-a549-fa9c33e66b7a", "name": "network-vif-plugged", "status": "completed", "tag": "c5f69ca6-d120-49a3-a890-77e4b7429ad9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:12.951471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-bbcaa438-338c-45b9-8c16-cf41f6d8dc2d req-651f4c80-b735-4f4e-a5ed-f0e885ecbea9 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:12.953055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-bbcaa438-338c-45b9-8c16-cf41f6d8dc2d req-651f4c80-b735-4f4e-a5ed-f0e885ecbea9 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:12.969654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-bbcaa438-338c-45b9-8c16-cf41f6d8dc2d req-651f4c80-b735-4f4e-a5ed-f0e885ecbea9 service nova] Creating event network-vif-plugged:c5f69ca6-d120-49a3-a890-77e4b7429ad9 for instance 850b5395-31f3-43e6-a549-fa9c33e66b7a on hv-cinder-82880 May 26 21:32:12.970448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:12.975240 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-bbcaa438-338c-45b9-8c16-cf41f6d8dc2d req-651f4c80-b735-4f4e-a5ed-f0e885ecbea9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038166 May 26 21:32:12.976087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 335/633] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:32:12.982424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:12.984067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:12.986672 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e93cabff-1fe3-42d4-ad1f-266305a6fb7b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.202753 May 26 21:32:12.987693 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 299/634] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:12 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:13.329549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:13.330247 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:13.336667 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:13.337036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:13.337803 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:13.338239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:13.474980 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:13.482686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-985e8fec-96e5-4837-9abe-38fc5c241cde tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.157400 May 26 21:32:13.483255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 336/635] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:13 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:13.831345 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:13.831993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:13.838636 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:13.845631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:13.845631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:13.845631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:13.975913 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:13.985229 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ac8c5d79-0e9f-4e69-9f51-3c435d8c020b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.158260 May 26 21:32:13.985927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 300/636] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:13 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:14.005531 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:14.006598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:14.013706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:14.015258 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:14.015711 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:14.016186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:14.147043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:14.158706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:14.160270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:14.161510 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-aec877ac-92a9-4571-84b7-30d67e55854c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.159961 May 26 21:32:14.162080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 337/637] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:14 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:14.499991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:14.500587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:14.506867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:14.507314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:14.508108 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:14.508538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:14.641701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:14.649357 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-83b792d4-eaae-4d3b-b2f4-9455e2fdbd83 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.153426 May 26 21:32:14.649917 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 301/638] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:14 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:15.001703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:15.002311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:15.008473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:15.009065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:15.009690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:15.010123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:15.141967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:15.149594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0e6d73dd-9eb4-4506-b1cf-f81b45df43cc tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.151703 May 26 21:32:15.150168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 338/639] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:14 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:15.180631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:15.181267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:15.188421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:15.188870 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:15.189632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:15.190068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:15.318320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:15.326771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:15.328511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:15.329579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e46c2126-ac77-490e-9a35-a4fa8c5b676b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.152882 May 26 21:32:15.330136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 302/640] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:15 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:15.765218 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:15.765826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:15.771939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:15.772391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:15.773155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:15.773596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:15.899556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:15.907524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5fc4b2c3-f820-4ae6-898a-8c897ed3e308 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.244566 May 26 21:32:15.908117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 339/641] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:15 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:16.166213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:16.166819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:16.173673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:16.174123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:16.174887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:16.175584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:16.178127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:16.311029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:16.318513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-60705c2e-6b79-446e-94bf-2e4d3dbc5299 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.156085 May 26 21:32:16.320669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 303/642] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:16 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:16.347731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:16.348379 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:16.354917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:16.355365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:16.356144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:16.356578 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:16.497810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:16.507327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:16.509981 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:16.513216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8368cc0b-3b2a-4cbb-ac7c-d8ff3768ca2a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.167333 May 26 21:32:16.513216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 340/643] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:16 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:16.925253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:16.925861 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:16.931972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:16.932421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:16.933184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:16.933617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:17.067553 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:17.077687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e74010bf-e27d-4164-b6bc-c124ee519e08 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.157154 May 26 21:32:17.078268 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 304/644] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:16 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:17.336278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:17.336885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:17.344529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:17.345060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:17.345908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:17.346353 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:17.478929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:17.486620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a681c322-d174-4593-909f-93173e7ff281 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.154229 May 26 21:32:17.487179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 341/645] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:17 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:17.529052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:17.529718 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:17.536949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:17.537391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:17.538145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:17.538573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:17.681213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:17.689983 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:17.691537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:17.692758 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-339418ec-7d08-460b-917a-1229ffa06a42 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.167644 May 26 21:32:17.693498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 305/646] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:17 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:18.095179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:18.095812 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:18.102006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:18.102453 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:18.103217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:18.103656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:18.235528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:18.243171 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-322f5109-8a82-4924-ac12-ddabc9c4a1a3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.152589 May 26 21:32:18.243736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 342/647] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:18 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:18.504656 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:18.505267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:18.511345 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:18.511828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:18.512638 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:18.513029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:18.647386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:18.654842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5ef6e7ed-7fef-46e8-89f8-5bdf8f02ec18 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.155254 May 26 21:32:18.655634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 306/648] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:18 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:18.710654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:18.711270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:18.717559 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:18.718019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:18.718802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:18.719384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:18.857361 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:18.866248 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:18.867937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:18.869225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9941fa36-4d10-4504-9db7-3ae39b65abd2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.162510 May 26 21:32:18.869787 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 343/649] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:18 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:19.259686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:19.260312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:19.266366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:19.266807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:19.267556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:19.268011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:19.399259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:19.407259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c005bcdd-c614-497f-b317-0cac2175c225 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.151342 May 26 21:32:19.407952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 307/650] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:19 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:19.672236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:19.672796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:19.680114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:19.680569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:19.681345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:19.681794 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:19.809273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:19.817306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2b073763-0cc9-4db2-8edc-15eb66ba1c21 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.149691 May 26 21:32:19.817857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 344/651] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:19 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:19.889471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:19.890077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:19.896583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:19.897017 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:19.897779 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:19.898214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:20.023431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:20.032554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:20.034076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:20.035215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dad6a4a3-25ca-4e75-bd17-f2630fd085b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.149652 May 26 21:32:20.035852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 308/652] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:19 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:20.424225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:20.424827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:20.431992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:20.432673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:20.433546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:20.433985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:20.565144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:20.572649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3049cacf-7e84-4572-9bfc-a59bfe15d72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.152352 May 26 21:32:20.573217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 345/653] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:20 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:20.835097 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:20.835630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:20.841806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:20.842258 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:20.843032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:20.843468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:20.975217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:20.983000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bc77e35e-6bbe-437f-994e-1eef7531422c tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.151887 May 26 21:32:20.983587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 309/654] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:20 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:21.053846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:21.054451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:21.061043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:21.061493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:21.062841 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:21.063273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:21.193361 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:21.203213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:21.204764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:21.205936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4535780b-535f-482b-832a-b5db50638959 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.156360 May 26 21:32:21.206776 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 346/655] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:21 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:21.589200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:21.589800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:21.596481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:21.596927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:21.597685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:21.598113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:21.727395 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:21.734848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0e3707d6-a96a-42b2-a61f-b45c442a8b93 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.149530 May 26 21:32:21.735413 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 310/656] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:21 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:22.000077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:22.000614 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:22.006845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:22.007294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:22.008099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:22.008539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:22.141924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:22.149317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5a11cffc-2b17-4584-93ae-27ca61b900b1 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.153239 May 26 21:32:22.155887 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 347/657] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:21 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:22.229434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:22.230035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:22.237019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:22.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:22.238227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:22.238685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:22.378565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:22.388447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:22.388748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:22.389911 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0d2772af-4199-48d7-89f9-5c5d33fcee3a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.164433 May 26 21:32:22.396275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 311/658] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:22 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:22.753776 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:22.754582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:22.761397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:22.761859 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:22.762703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:22.763231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:22.924322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:22.932376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-96eec0a8-937c-4b70-adf1-34ebaf9795be tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.183905 May 26 21:32:22.933451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 348/659] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:22 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:23.165683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:23.166334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:23.173120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:23.173561 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:23.174318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:23.174745 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:23.313996 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:23.322108 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b1464515-b839-4991-a314-58d6a8823006 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.160314 May 26 21:32:23.328286 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 312/660] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:23 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:23.409550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:23.410189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:23.416919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:23.417434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:23.418273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:23.418770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:23.551112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:23.559908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:23.561495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:23.563237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-648801ae-0af1-4f97-a192-2055dbc24e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.158427 May 26 21:32:23.563841 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 349/661] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:23 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:23.949558 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:23.950193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:23.958223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:23.958223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:23.958223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:23.958223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:24.061001 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-f7b95bf1-989e-49be-947b-842e5f6f9693 req-12a890e8-c7d1-4a33-9959-3df0935557ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47b8242-7a18-4ea5-b647-3ac7c275bdab", "name": "network-vif-plugged", "status": "completed", "tag": "3ee57c28-7886-4588-b610-9158fcb5e1b2"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:24.070814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-f7b95bf1-989e-49be-947b-842e5f6f9693 req-12a890e8-c7d1-4a33-9959-3df0935557ff service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:24.071306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-f7b95bf1-989e-49be-947b-842e5f6f9693 req-12a890e8-c7d1-4a33-9959-3df0935557ff service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:24.082671 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-f7b95bf1-989e-49be-947b-842e5f6f9693 req-12a890e8-c7d1-4a33-9959-3df0935557ff service nova] Creating event network-vif-plugged:3ee57c28-7886-4588-b610-9158fcb5e1b2 for instance f47b8242-7a18-4ea5-b647-3ac7c275bdab on hv-cinder-82880 May 26 21:32:24.087884 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-f7b95bf1-989e-49be-947b-842e5f6f9693 req-12a890e8-c7d1-4a33-9959-3df0935557ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030343 May 26 21:32:24.090131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 350/662] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:32:24.106073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:24.114008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0e79a0b9-3552-4d35-8b0c-631e51c98162 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.168325 May 26 21:32:24.114607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 313/663] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:23 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:24.340385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:24.340992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:24.347864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:24.348311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:24.349061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:24.349491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:24.484605 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:24.492140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ecd18985-b602-4276-bcd5-97a2da72a6e5 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.156019 May 26 21:32:24.492717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 351/664] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:24 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:24.582447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:24.583070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:24.590244 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:24.590906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:24.591725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:24.592232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:24.727800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:24.736260 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:24.737782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:24.738929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9d339e22-a515-45d9-b10e-9255bc073689 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1752 microversion: 2.20 time: 0.160432 May 26 21:32:24.739487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 314/665] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:24 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:25.132550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:25.133070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:25.139309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:25.139770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:25.140526 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:25.140961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:25.157304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:25.277921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:25.285747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bad8904e-262f-4145-94fa-958518a97b48 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.157179 May 26 21:32:25.286324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 352/666] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:25 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:25.509288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:25.509898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:25.515991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:25.516473 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:25.517227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:25.517656 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:25.650158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:25.661952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fcbfe00e-6067-4a37-9a7d-108c3a861de9 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1318 microversion: 2.1 time: 0.152506 May 26 21:32:25.661952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 315/667] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:25 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:25.759725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:25.759725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:25.764706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:25.765148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:25.765903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:25.766398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:25.897797 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:25.906500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:25.908562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:25.909717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5fb57220-a337-4ba9-94d3-96babdffde51 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.156087 May 26 21:32:25.910270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 353/668] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:25 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:26.302849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:26.303361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:26.309474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.309920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.310681 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.311122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.440407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:26.448008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a8a6ca25-c798-44ba-ae38-4161c41af798 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.149372 May 26 21:32:26.448594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 316/669] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:26 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:26.675619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:26.676264 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:26.685706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.686155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.686926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.687363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.822770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:26.830281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-31b96573-7df6-4653-9a32-cb4143084781 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1506 microversion: 2.1 time: 0.159449 May 26 21:32:26.830834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 354/670] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:26 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:26.847445 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49079395-f843-4fce-b797-6ab3bea9768f", "device": "/dev/sdb"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:26.849189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:26.856009 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.856487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.857247 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.857686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.929128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:26.930129 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:26.936529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.937150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:26.937931 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:26.939073 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:27.079282 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:27.088314 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:27.089891 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:27.091706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-65620766-1439-462e-af2d-df8d3f8d35f0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.167227 May 26 21:32:27.091706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 355/671] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:26 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:27.465596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:27.466124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:27.472319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:27.472819 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:27.473582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:27.474021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:27.609623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:27.618087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-581bb7c0-cba4-439e-b8e0-8566a5fc602d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.156390 May 26 21:32:27.619047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 356/672] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:27 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:27.765259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d848b021-27f4-4cd0-a89f-d25fe827cb3b tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "POST /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.922322 May 26 21:32:27.765862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 317/673] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:32:26 2022] POST /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a/os-volume_attachments => generated 194 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:32:28.110436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:28.110901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:28.117472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:28.117920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:28.118685 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:28.119199 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:28.274484 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:28.285653 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:28.287462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:28.288832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d380a7d8-e32e-4f63-bdac-a9523043a10c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.183002 May 26 21:32:28.289885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 357/674] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:28 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:28.635598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:28.636379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:28.643390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:28.643595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:28.644438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:28.644885 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:28.660088 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:28.780288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:28.792716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4d2f6058-dff2-4cdb-8477-f99e2f1da8b9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1366 microversion: 2.1 time: 0.158432 May 26 21:32:28.792716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 318/675] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:28 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:29.307149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:29.307845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:29.314588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:29.315040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:29.315874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:29.317131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:29.454634 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:29.463282 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:29.464833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:29.465985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d92e068d-8cf5-4515-9c12-918a5e60fa8c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.162985 May 26 21:32:29.466544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 358/676] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:29 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:29.808543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:29.809336 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:29.817078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:29.817522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:29.818492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:29.818966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:29.992318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:29.999803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8ad67268-b456-41f0-8d1a-6585293cd529 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1555 microversion: 2.1 time: 0.195154 May 26 21:32:30.000364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 319/677] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:29 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:30.016390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:30.016887 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:30.023153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:30.023621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:30.024431 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:30.024870 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:30.109358 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-119cdef8-4c84-4580-b3ab-42c49d3e7347 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096748 May 26 21:32:30.110570 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 359/678] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:32:30 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:32:30.484990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:30.486158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:30.493586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:30.494535 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:30.495530 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:30.496366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:30.646330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:30.655583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:30.657948 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:30.659184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3b788a3c-508e-4885-b3c4-d326221d5ab4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.178386 May 26 21:32:30.660032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 320/679] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:30 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:31.315677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-a80308cd-274b-450e-907f-3a5ed3e641c9 req-4132a833-0edc-49de-b777-aa44462c514a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47b8242-7a18-4ea5-b647-3ac7c275bdab", "tag": "3ee57c28-7886-4588-b610-9158fcb5e1b2"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:31.323955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-a80308cd-274b-450e-907f-3a5ed3e641c9 req-4132a833-0edc-49de-b777-aa44462c514a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:31.324396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-a80308cd-274b-450e-907f-3a5ed3e641c9 req-4132a833-0edc-49de-b777-aa44462c514a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:31.336180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-a80308cd-274b-450e-907f-3a5ed3e641c9 req-4132a833-0edc-49de-b777-aa44462c514a service nova] Creating event network-changed:3ee57c28-7886-4588-b610-9158fcb5e1b2 for instance f47b8242-7a18-4ea5-b647-3ac7c275bdab on hv-cinder-82880 May 26 21:32:31.341187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-a80308cd-274b-450e-907f-3a5ed3e641c9 req-4132a833-0edc-49de-b777-aa44462c514a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188647 May 26 21:32:31.341777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 360/680] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:32:31.679173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:31.680072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:31.687045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:31.687501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:31.688894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:31.689337 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:31.837456 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:31.846660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:31.848202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:31.849352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4f555ecc-5753-4f33-9b8d-9034d3a7feca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.174635 May 26 21:32:31.850103 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 321/681] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:31 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:32.868181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:32.868873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:32.870791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=88 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:32.875834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:32.876276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:32.877033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:32.877467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:33.015568 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:33.024569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:33.026083 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:33.027234 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-051ca8fe-f092-45bb-b806-2df7dc18c067 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.163862 May 26 21:32:33.027810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 361/682] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:32 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:34.046181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:34.046734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:34.054837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:34.055275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:34.056052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:34.056479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:34.215964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:34.224980 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:34.226498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:34.227643 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f66c686a-caa8-410d-9714-eb924b7e58c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.185472 May 26 21:32:34.228227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 322/683] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:34 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:35.245470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:35.246076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:35.253697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:35.254152 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:35.255092 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:35.255536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:35.393479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:35.401967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:35.403491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:35.404669 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4c88d655-aaac-4b62-80ae-5d5534e1250f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.163018 May 26 21:32:35.405228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 362/684] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:35 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:36.422649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:36.423397 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:36.431053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:36.431501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:36.432316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:36.432769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:36.568893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:36.578602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:36.580868 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:36.583910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-51a9a49e-3c71-45c5-bdc3-1302225731e9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.163545 May 26 21:32:36.583910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 323/685] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:36 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:37.600651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:37.602086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:37.612896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:37.613606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:37.614405 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:37.614893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:37.754994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:37.763818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:37.765384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:37.766543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0573535b-4d66-44b9-a1ad-7a4bcf9c619a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.170233 May 26 21:32:37.767210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 363/686] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:37 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:38.410455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-512875891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-854379751", "security_groups": [{"name": "tempest-secgroup-smoke-1703846925"}], "networks": [{"uuid": "084061c1-c7dc-4f5f-8186-748f557a8665"}], "block_device_mapping_v2": [{"uuid": "d0b5b9f9-b9f4-464a-868b-9e13c269a414", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:38.429282 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=62 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:38.536817 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] validate_networks() for [('084061c1-c7dc-4f5f-8186-748f557a8665', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:32:38.784784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:38.785397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:38.792770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:38.793224 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:38.794000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:38.794436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:38.931375 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:38.940684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:38.942191 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:38.943350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-34ca69dd-bbf4-47a9-a6c3-5aedb2b38832 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.162923 May 26 21:32:38.943920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 364/687] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:38 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:39.038329 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:32:39.038707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:32:39.039155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:32:39.039595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:32:39.039994 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:32:39.049860 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:39.050312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:39.051100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:39.051528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:39.070388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Getting quotas for project 77c3cd3a54424befb4b424e6de1f7870. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:32:39.074569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Getting quotas for user 38166757db224367bb8208f6366a4184 and project 77c3cd3a54424befb4b424e6de1f7870. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:32:39.135188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:32:39.137507 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0b5b9f9-b9f4-464a-868b-9e13c269a414',volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:32:39.636778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-32779c1f-b211-43a6-844e-e47903162a9a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.231806 May 26 21:32:39.637524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 324/688] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:32:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:32:39.649999 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ecdfa8a7-73ea-49cf-bea1-271cdee20f05 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:39.658382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ecdfa8a7-73ea-49cf-bea1-271cdee20f05 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:39.709517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ecdfa8a7-73ea-49cf-bea1-271cdee20f05 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:39.717734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ecdfa8a7-73ea-49cf-bea1-271cdee20f05 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1087 microversion: 2.1 time: 0.072123 May 26 21:32:39.718814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 365/689] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:39 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:39.963474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:39.964021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:39.971064 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:39.984867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:39.984867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:39.984867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:40.106441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:40.119391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:40.121130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:40.122411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-83b4e709-3450-448a-b8a7-959880fc01f5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.164191 May 26 21:32:40.123518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 325/690] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:39 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:40.737503 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:40.738104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:40.745005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:40.745441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:40.746210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:40.746853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:40.814920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:40.822433 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ac3e05f4-b2a8-4131-9c2c-e274c00fdd7d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.089688 May 26 21:32:40.822987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 366/691] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:40 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:41.141585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:41.142657 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:41.149207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:41.149654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:41.150419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:41.150854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:41.286941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:41.295968 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:41.297486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:41.298651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8a33d206-7a75-4e1e-abeb-d3472b6f386c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.161099 May 26 21:32:41.304399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 326/692] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:41 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:41.838441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:41.839019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:41.846070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:41.846518 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:41.847282 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:41.847715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:41.911976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:41.920110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-867cb2e1-a646-46b6-acaa-ec194527b0a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.085435 May 26 21:32:41.920952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 367/693] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:41 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:42.318811 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:42.319453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:42.326126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:42.326603 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:42.327453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:42.328000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:42.481683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:42.490194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:42.491712 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:42.492871 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-52bc938a-eab3-4a19-95b3-d8be0d35b1b5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.178106 May 26 21:32:42.493432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 327/694] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:42 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:42.936755 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:42.937352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:42.944515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:42.944961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:42.945721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:42.946157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:43.010861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:43.018905 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e74b34f3-f7d7-440e-9d46-ce49f731a5a8 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.085983 May 26 21:32:43.019844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 368/695] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:42 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:43.513773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:43.514344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:43.521688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:43.522138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:43.522918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:43.523365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:43.673490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:43.682807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:43.684426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:43.685577 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0e80e338-3525-4ef4-84a9-f45d1d05448a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.175878 May 26 21:32:43.686130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 328/696] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:43 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:44.035724 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:44.036390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:44.042868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:44.043317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:44.044243 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:44.044689 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:44.104970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:44.112732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d68590af-f9d1-470d-9b64-330aa8bdf6df tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.080803 May 26 21:32:44.113307 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 369/697] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:44 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:44.705441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:44.706771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:44.714735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:44.715515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:44.716590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:44.717060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:44.877142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:44.886016 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:44.887604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:44.888738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a67e13b6-588c-4772-be0c-30efabbf51e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.187761 May 26 21:32:44.889293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 329/698] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:44 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:45.129621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:45.130198 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:45.136767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:45.137225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:45.137996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:45.138440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:45.224187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:45.231765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-13c57bf9-f943-47c2-a110-a7dcb3f88559 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.106083 May 26 21:32:45.232337 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 370/699] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:45 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:45.906214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:45.906836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:45.913385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:45.913828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:45.914579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:45.915004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:46.051875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:46.060290 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:46.061979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:46.063126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-63645b22-8faa-47f7-9ba5-8f01265827e3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.160764 May 26 21:32:46.063677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 330/700] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:45 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:46.248304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:46.248926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:46.255511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:46.256004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:46.256780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:46.257213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:46.259914 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:46.318220 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:46.325465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8f422573-7cad-490e-b8a0-9a90d5a8fb93 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.081066 May 26 21:32:46.326052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 371/701] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:46 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:47.081824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:47.082386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:47.088978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:47.089430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:47.090200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:47.090635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:47.218960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:47.225152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:47.226772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:47.227995 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e3c62d89-9e0e-479b-8ff5-fcdcebcc5f26 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.150765 May 26 21:32:47.228549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 331/702] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:47 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:47.342241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:47.342794 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:47.349238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:47.349693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:47.350460 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:47.350898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:47.413781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:47.421439 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bb514870-aba9-4722-bf08-bc57c73a6c11 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.083191 May 26 21:32:47.421997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 372/703] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:47 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:48.246663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:48.247207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:48.254238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:48.254680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:48.255442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:48.255901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:48.380870 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:48.389303 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:48.390829 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:48.392001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-657d3435-e7ed-45fc-aa4c-ef5273f1eda3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.149328 May 26 21:32:48.393162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 332/704] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:48 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:48.438319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:48.441912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:48.445470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:48.445917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:48.446676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:48.447128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:48.510419 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:48.518676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1ecaee26-e7c4-4a7c-a305-17c730a5c771 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.084264 May 26 21:32:48.519275 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 373/705] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:48 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:49.410906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:49.411487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:49.413411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:49.414166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:49.419587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:49.420063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:49.421216 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:49.421660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:49.535157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:49.535774 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:49.542410 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:49.542864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:49.543643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:49.544112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:49.556765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:49.565935 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:49.567475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:49.568697 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2857564e-a28a-4786-a3b8-0d3d03a62e32 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.162016 May 26 21:32:49.569270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 333/706] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:49 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:49.607311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:49.615543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4a62d82c-3933-4ff6-ba28-a09bc6939dbe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1137 microversion: 2.1 time: 0.084347 May 26 21:32:49.616460 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 374/707] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:49 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:50.590377 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:50.590952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:50.597596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:50.598076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:50.598856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:50.599287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:50.632401 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:50.633002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:50.634802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:50.640209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:50.640669 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:50.641454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:50.641897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:50.706907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:50.713582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0a0eaacc-10ee-4417-8670-885c779af54e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1129 microversion: 2.1 time: 0.085084 May 26 21:32:50.714166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 375/708] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:50 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1129 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:32:50.739673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:50.748321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:50.749857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:50.751012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3ed2b3e7-aae9-40ab-8178-4f36bf39da1e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.164772 May 26 21:32:50.751573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 334/709] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:50 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:51.730269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:51.730874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:51.737458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:51.737955 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:51.738652 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:51.739087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:51.769460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:51.770063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:51.776703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:51.777149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:51.777923 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:51.778358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:51.801639 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:51.809285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e97ca6cb-cb28-43ea-963d-ae46c17a38f3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1129 microversion: 2.1 time: 0.082803 May 26 21:32:51.810012 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 376/710] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:51 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1129 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:51.907764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:51.909937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:51.916676 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:51.918193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:51.919422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fb2608eb-6630-4d14-b122-8018c9ab94af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.154247 May 26 21:32:51.919936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 335/711] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:51 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:52.825450 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:52.826880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:52.834782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:52.835583 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:52.836660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:52.837187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:52.901289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:52.908717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bca41950-ac33-4726-bc45-209971258efc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1129 microversion: 2.1 time: 0.087545 May 26 21:32:52.909325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 377/712] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:52 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1129 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:52.944923 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:52.945501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:52.952348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:52.952838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:52.953587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:52.954019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:53.081661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:53.090072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:53.091586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:53.092767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-474e3fed-074b-41d2-b4d5-9d11877808e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.152271 May 26 21:32:53.093317 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 336/713] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:52 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:53.926095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:53.926686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:53.933270 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:53.933712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:53.934463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:53.934895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:53.994739 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:54.002111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-00be729c-70c5-4246-a082-c81c84e7ad89 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1185 microversion: 2.1 time: 0.080703 May 26 21:32:54.003348 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 378/714] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:53 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:54.110328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:54.110936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:54.118136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:54.118583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:54.119342 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:54.119806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:54.251130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:54.260140 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:54.261725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:54.262895 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e7eb9e26-e3b0-463c-9058-e0094a1a2202 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.156464 May 26 21:32:54.263455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 337/715] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:54 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:55.019996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:55.020637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:55.027201 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:55.027649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:55.028445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:55.028883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:55.089287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:55.096734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-51e42de9-3fc4-4f93-917b-eb7700ba812a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1185 microversion: 2.1 time: 0.081258 May 26 21:32:55.097228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 379/716] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:55 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:55.281245 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:55.281850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:55.288530 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:55.288977 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:55.289739 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:55.290173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:55.420637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:55.429733 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:55.431305 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:55.432504 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-63b75141-993d-431e-bff9-f58c89ba1cdd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.155190 May 26 21:32:55.433066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 338/717] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:55 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:56.113702 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:56.114325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:56.121382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:56.122146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:56.122937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:56.123551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:56.194599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:56.202657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ec26613b-5a95-4ec9-9b34-d179763121f4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1185 microversion: 2.1 time: 0.093111 May 26 21:32:56.203261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 380/718] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:56 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:56.454315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:56.454315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:56.463232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:56.463888 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:56.464756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:56.465465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:56.613277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:56.622165 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:56.623862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:56.625107 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-96947b9d-f615-4463-afa5-4768331161bd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.178651 May 26 21:32:56.625663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 339/719] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:56 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:57.275332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:57.276088 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:57.282624 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:57.283070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:57.283921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:57.284360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:57.483715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:57.491314 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-70acd175-142f-4420-a289-6a15938424fe tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1271 microversion: 2.1 time: 0.219748 May 26 21:32:57.491918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 381/720] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:57 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:57.644661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:57.645273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:57.651927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:57.652406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:57.653183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:57.653615 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:57.796027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:57.805278 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:57.808883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:57.808883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8b49b259-b899-4c8a-a166-0f7150059e7e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.168217 May 26 21:32:57.808883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 340/721] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:57 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:32:58.168100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-58678729-4292-44dd-830c-8ea063f38db7 req-cd284a7f-46cc-445e-b4e9-f00c7f85469d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:58.178181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-58678729-4292-44dd-830c-8ea063f38db7 req-cd284a7f-46cc-445e-b4e9-f00c7f85469d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:58.178714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-58678729-4292-44dd-830c-8ea063f38db7 req-cd284a7f-46cc-445e-b4e9-f00c7f85469d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:58.193881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-58678729-4292-44dd-830c-8ea063f38db7 req-cd284a7f-46cc-445e-b4e9-f00c7f85469d service nova] Creating event network-changed:5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a for instance 7586f603-aaac-433d-85db-77c2893aa328 on hv-cinder-82880 May 26 21:32:58.198919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-58678729-4292-44dd-830c-8ea063f38db7 req-cd284a7f-46cc-445e-b4e9-f00c7f85469d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034536 May 26 21:32:58.204676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 382/722] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:32:58.508774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:58.509385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:58.515523 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:58.516006 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:58.516780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:58.517223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:58.645969 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:58.653797 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d3e6711c-9b16-4fd4-8efa-275a423a6a99 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1271 microversion: 2.1 time: 0.149005 May 26 21:32:58.654356 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 341/723] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:58 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:58.827437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:58.828079 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:58.835316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:58.835782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:58.836579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:58.837009 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:58.964225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:58.973086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:58.974579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:58.975712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-082e4216-e061-49f4-ae29-63c56bc201f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.153096 May 26 21:32:58.976296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 383/724] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:58 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:59.670590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:59.671187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:59.680360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:59.681089 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:59.682081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:59.682748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:59.832253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:59.840416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bffdebc0-fa5b-4ed5-bf41-e4114fe95281 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1271 microversion: 2.1 time: 0.173668 May 26 21:32:59.841297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 342/725] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:32:59 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:59.994150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:59.994858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:00.001617 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:00.002074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:00.003491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:00.003973 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:00.132610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:00.141072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:00.142660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:00.143847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1f4b7d13-acf6-4992-8b5f-67bb680dd477 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.153564 May 26 21:33:00.144412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 384/726] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:32:59 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:00.857154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:00.857782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:00.864301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:00.864745 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:00.865505 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:00.865937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:00.999973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:01.007405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cf1df49f-ed23-4d5b-a127-4f29f38d644a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1271 microversion: 2.1 time: 0.154138 May 26 21:33:01.008005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 343/727] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:00 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:01.163541 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:01.164210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:01.170689 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:01.171135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:01.171934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:01.172365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:01.316885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:01.325463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:01.326984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:01.328181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-75c41fda-5a47-420e-a336-aa967511c01c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.169063 May 26 21:33:01.328758 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 385/728] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:01 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:02.024027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:02.024633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:02.031179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:02.031625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:02.032419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:02.032848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:02.162838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:02.170549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2481310d-d652-46cb-a2c9-4584fd37f6d2 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1271 microversion: 2.1 time: 0.150445 May 26 21:33:02.171118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 344/729] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:02 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:02.346363 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:02.346908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:02.353443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:02.353894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:02.354661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:02.355132 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:02.485708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:02.495216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:02.496824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:02.497987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-06c7a21f-4ebd-4312-91e9-35335e0d1c43 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.155558 May 26 21:33:02.498548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 386/730] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:02 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:03.187989 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:03.188592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:03.195123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:03.195565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:03.196403 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:03.196839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:03.332121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:03.339823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-babf5ee2-0d09-438c-bcda-7aa79f1fdeb6 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.155671 May 26 21:33:03.340407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 345/731] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:03 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:03.516169 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:03.516786 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:03.521047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=54 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:03.524683 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:03.525070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:03.525842 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:03.526280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:03.818885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:03.827542 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:03.829222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:03.830383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-978881c4-77a9-4929-9376-cade196c073c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.318270 May 26 21:33:03.831539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 387/732] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:03 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:04.357191 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:04.357750 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:04.369278 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:04.373113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:04.373113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:04.373113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:04.519647 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:04.527255 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ded1cc8a-5b8e-499c-9a3b-b4430c32f5eb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.173967 May 26 21:33:04.528014 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 346/733] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:04 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:04.815393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-9a881afb-4e0c-4b2f-aff3-e9dba0b21911 req-2d6ad78a-3b0f-471c-beb7-7e2bc9196288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "name": "network-vif-plugged", "status": "completed", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:33:04.824383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-9a881afb-4e0c-4b2f-aff3-e9dba0b21911 req-2d6ad78a-3b0f-471c-beb7-7e2bc9196288 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:04.824831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-9a881afb-4e0c-4b2f-aff3-e9dba0b21911 req-2d6ad78a-3b0f-471c-beb7-7e2bc9196288 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:04.835966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-9a881afb-4e0c-4b2f-aff3-e9dba0b21911 req-2d6ad78a-3b0f-471c-beb7-7e2bc9196288 service nova] Creating event network-vif-plugged:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:33:04.840992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-9a881afb-4e0c-4b2f-aff3-e9dba0b21911 req-2d6ad78a-3b0f-471c-beb7-7e2bc9196288 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083082 May 26 21:33:04.841612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 388/734] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:33:04.848776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:04.849382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:04.855444 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:04.857956 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:04.857956 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:04.857956 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:04.985322 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:04.994416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:04.995973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:04.997120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8b16f7ff-770b-4cb8-89b0-a43758b090ce tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.152754 May 26 21:33:04.997675 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 347/735] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:04 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:33:05.544077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:05.544763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:05.551271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:05.551809 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:05.552490 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:05.552925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:05.556838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:05.685355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:05.692897 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ccb93451-8931-431c-8509-3514eb3036db tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.153047 May 26 21:33:05.693457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 389/736] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:05 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:06.015503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:06.016093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:06.023019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:06.023471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:06.024261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:06.024698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:06.154970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:06.164010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:06.165526 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:06.166659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c1c3a927-ba7f-49de-9748-4c3c43a8c349 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.155237 May 26 21:33:06.167210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 348/737] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:06 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:06.709482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:06.710101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:06.716713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:06.717798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:06.718604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:06.719077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:06.846601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:06.854010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3314ba86-2076-42a0-80bd-260cbcd4617e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.148383 May 26 21:33:06.854569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 390/738] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:06 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:07.184992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:07.185588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:07.192071 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:07.192521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:07.193281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:07.193713 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:07.323201 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:07.332246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:07.333778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:07.334937 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2d0f7f7b-28fc-420c-8286-f4837f83f42a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.153823 May 26 21:33:07.335498 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 349/739] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:07 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:07.871472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:07.872140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:07.878649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:07.879092 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:07.879875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:07.880306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:08.011959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:08.019429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0a0f4746-ea90-4946-82ba-bc9d287f0d06 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.151917 May 26 21:33:08.020033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 391/740] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:07 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:08.353388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:08.354021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:08.360442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:08.360882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:08.361634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:08.362138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:08.492491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:08.500284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:08.501939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:08.503915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-25bb4ff9-e3e8-4e37-8b80-0137a61664ae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.154042 May 26 21:33:08.503915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 350/741] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:08 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:09.036249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:09.037506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:09.044350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:09.044804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:09.045573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:09.046050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:09.172917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:09.181108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ededfc11-ebe9-43fd-9cfc-5999f50ec5b7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.148833 May 26 21:33:09.181660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 392/742] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:09 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:09.521737 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:09.522325 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:09.524610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:09.529527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:09.529972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:09.530837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:09.531269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:09.665953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:09.674569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:09.676148 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:09.677280 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7739e90f-9349-4f6c-9e54-e8557fcbfaae tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.159534 May 26 21:33:09.677835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 351/743] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:09 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:10.197958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:10.198592 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:10.205352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:10.205830 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:10.206605 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:10.207046 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:10.342076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:10.349872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-434abffb-e611-4138-8b0e-fffec6860008 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.155591 May 26 21:33:10.350450 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 393/744] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:10 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:10.696275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:10.696914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:10.703685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:10.704153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:10.704962 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:10.705651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:10.720807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:10.852486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:10.861179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:10.862735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:10.863912 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9794580a-7bf2-495b-b301-64fcf54d9e1f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.171527 May 26 21:33:10.864474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 352/745] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:10 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:33:11.367115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:11.367718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:11.374265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:11.374714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:11.375469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:11.375934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:11.506920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:11.514443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-da29f078-77e4-4422-99c8-815f2060744d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.151204 May 26 21:33:11.515006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 394/746] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:11 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:11.881981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:11.882780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:11.889521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:11.889972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:11.890725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:11.891157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:12.027562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:12.036353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:12.037875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:12.039040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cf78ff1a-db70-4f0c-a252-9c2dd23bdc8b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.161004 May 26 21:33:12.039599 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 353/747] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:11 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:12.531004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:12.531622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:12.538684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:12.540603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:12.540603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:12.540603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:12.675780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:12.683381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1531dd5d-1a3b-48ee-a529-1b8b25b05e20 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.156274 May 26 21:33:12.683985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 395/748] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:12 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:13.057880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:13.058496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:13.065509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:13.065960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:13.066778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:13.067209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:13.196936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:13.205290 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:13.207449 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:13.208609 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-20ca2f67-53e7-4a72-8a60-cce4b4fd65ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.154924 May 26 21:33:13.209179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 354/749] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:13 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:13.700311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:13.700881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:13.708246 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:13.708369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:13.709074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:13.709513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:13.842837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:13.850868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ad92061c-ea08-4446-9f11-c9a215e66758 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.154689 May 26 21:33:13.851436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 396/750] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:13 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:14.163143 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:14.163632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:14.170189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:14.170746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:14.171515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:14.171970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:14.227235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:14.227877 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:14.234101 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:14.234556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:14.235330 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:14.235799 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:14.298555 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lazy-loading 'services' on Instance uuid 850b5395-31f3-43e6-a549-fa9c33e66b7a {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:33:14.375357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:14.384062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:14.386171 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:14.386827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-746fa0bd-3a66-42a8-9de2-fb933ee56fe8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.163488 May 26 21:33:14.387395 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 397/751] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:14 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:33:14.581993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4c428d2a-16b1-4afc-931e-a279a222e701 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "DELETE /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a/os-volume_attachments/49079395-f843-4fce-b797-6ab3bea9768f" status: 202 len: 0 microversion: 2.1 time: 0.423027 May 26 21:33:14.584514 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 355/752] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:33:14 2022] DELETE /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a/os-volume_attachments/49079395-f843-4fce-b797-6ab3bea9768f => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:33:14.868104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:14.868656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:14.875103 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:14.875561 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:14.876371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:14.876814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:15.013938 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:15.021667 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-67509364-7ed2-4366-b4c0-bae845215df3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.157870 May 26 21:33:15.022229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 398/753] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:14 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:15.406941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:15.407657 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:15.414432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:15.414874 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:15.415630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:15.416091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:15.550540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:15.559120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:15.560684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:15.561838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-97f74a31-e922-4116-9457-9cc53071a8f3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1808 microversion: 2.20 time: 0.159688 May 26 21:33:15.562396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 356/754] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:15 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:16.039772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:16.040555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:16.049436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:16.049956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:16.050869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:16.051334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:16.186246 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:16.194342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b51f7416-26c3-4da9-aaf6-35e27a6ad740 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.159458 May 26 21:33:16.194901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 399/755] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:16 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:16.580102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:16.580696 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:16.587259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:16.587709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:16.588509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:16.588947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:16.722815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:16.731275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:16.732927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:16.734080 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9bb099fe-1c25-46d9-acd1-8fefbd109662 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1795 microversion: 2.20 time: 0.157962 May 26 21:33:16.734641 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 357/756] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:33:16 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:33:17.211616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:17.212357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:17.218904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:17.219358 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:17.220147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:17.220582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:17.353294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:17.360846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f348f540-8b6e-45ac-8e7d-7269d3f8a132 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.153837 May 26 21:33:17.361419 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 400/757] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:17 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:17.807105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:17.807650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:17.814166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:17.814612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:17.815906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:17.816344 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:17.841488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:33:18.177679 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-53438b7a-4f9e-486e-b6f3-4cf2010e2b50 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "DELETE /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 204 len: 0 microversion: 2.1 time: 0.373940 May 26 21:33:18.178354 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 358/758] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:33:17 2022] DELETE /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:33:18.186718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:18.187352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:18.194216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:18.194675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:18.195442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:18.195920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:18.323052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:18.331051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-067e15f9-f58d-4789-98ef-d12b23b40be4 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1512 microversion: 2.1 time: 0.148309 May 26 21:33:18.331624 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 401/759] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:18 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:18.377992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:18.378691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:18.385197 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:18.385643 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:18.386400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:18.386837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:18.519625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:18.527114 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5dd6c7cf-a594-428f-8172-c44994a20c19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.153394 May 26 21:33:18.527675 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 359/760] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:18 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:19.349214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:19.349766 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:19.356404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:19.356863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:19.357664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:19.358076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:19.492985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:19.500911 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fbcc74a8-fbc4-4f93-a9f5-acdf4d5b7d41 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1512 microversion: 2.1 time: 0.155632 May 26 21:33:19.501483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 402/761] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:19 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:19.544436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:19.545023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:19.552500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:19.552808 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:19.553610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:19.554042 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:19.685860 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:19.694055 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a86e2f9b-6ad0-43a6-b670-9dd6d0bb9602 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.153509 May 26 21:33:19.694847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 360/762] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:19 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:20.518879 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:20.520216 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:20.526733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:20.527267 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:20.528091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:20.528531 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:20.711313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:20.712032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:20.718625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:20.719267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:20.720129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:20.720634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:20.753054 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:20.761923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c13efc8b-a9b0-4fb2-8502-a642e1150dee tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1512 microversion: 2.1 time: 0.246952 May 26 21:33:20.762852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 403/763] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:20 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:20.860851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:20.869297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b0a51891-a1e1-43d4-b44e-e60f8ca56c86 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.162522 May 26 21:33:20.872031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 361/764] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:20 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:21.078299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-c2b19983-9c16-43ef-a78c-f8984af70761 req-2c4352e3-eccb-44eb-ab39-d5e25fbda2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850b5395-31f3-43e6-a549-fa9c33e66b7a", "name": "network-vif-deleted", "tag": "c5f69ca6-d120-49a3-a890-77e4b7429ad9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:33:21.086668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-c2b19983-9c16-43ef-a78c-f8984af70761 req-2c4352e3-eccb-44eb-ab39-d5e25fbda2bb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.090025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-c2b19983-9c16-43ef-a78c-f8984af70761 req-2c4352e3-eccb-44eb-ab39-d5e25fbda2bb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:21.097942 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-c2b19983-9c16-43ef-a78c-f8984af70761 req-2c4352e3-eccb-44eb-ab39-d5e25fbda2bb service nova] Creating event network-vif-deleted:c5f69ca6-d120-49a3-a890-77e4b7429ad9 for instance 850b5395-31f3-43e6-a549-fa9c33e66b7a on hv-cinder-82880 May 26 21:33:21.103586 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-c2b19983-9c16-43ef-a78c-f8984af70761 req-2c4352e3-eccb-44eb-ab39-d5e25fbda2bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028866 May 26 21:33:21.104328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 404/765] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:33:21.415124 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-14e059fc-1470-4544-a571-cf099eee9136 req-7ba6510f-61d9-40b6-bb39-6660b979cb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:33:21.423239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-14e059fc-1470-4544-a571-cf099eee9136 req-7ba6510f-61d9-40b6-bb39-6660b979cb76 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.427131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-14e059fc-1470-4544-a571-cf099eee9136 req-7ba6510f-61d9-40b6-bb39-6660b979cb76 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:21.437284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-14e059fc-1470-4544-a571-cf099eee9136 req-7ba6510f-61d9-40b6-bb39-6660b979cb76 service nova] Creating event network-vif-plugged:5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a for instance 7586f603-aaac-433d-85db-77c2893aa328 on hv-cinder-82880 May 26 21:33:21.442207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-14e059fc-1470-4544-a571-cf099eee9136 req-7ba6510f-61d9-40b6-bb39-6660b979cb76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030942 May 26 21:33:21.450145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 362/766] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:33:21.780925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:21.781626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:21.789169 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.789621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:21.790696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.791036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:21.821653 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.822098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:21.822552 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lazy-loading 'fault' on Instance uuid 850b5395-31f3-43e6-a549-fa9c33e66b7a {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:33:21.865899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a658b1951a9426d94341940d87b5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a97f689104e4884b6e30b0c8606b513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:21.873531 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ff05ae47-d695-45ea-a9e4-2d2607434f1a tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 200 len: 1308 microversion: 2.1 time: 0.097345 May 26 21:33:21.880922 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 405/767] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:21 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:21.887099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:21.887824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:21.894573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.895021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:21.895804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:21.896291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:22.034670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:22.042303 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-efb2ab76-bbfa-4971-b849-b0cd8ed0f004 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.160171 May 26 21:33:22.042873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 363/768] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:21 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:22.890388 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:22.890997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] [instance: 850b5395-31f3-43e6-a549-fa9c33e66b7a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:22.898414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:22.898875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:22.899651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:22.900122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:22.904313 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:22.913719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] HTTP exception thrown: Instance 850b5395-31f3-43e6-a549-fa9c33e66b7a could not be found. May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Request method failure captured: May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a HTTP/1.1 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_EGLXBSundPAxxqxXCjDKcJgE-qlEcTiF-x4nukWHWrVWsmDHJrZcc9-wLfZZ-UkwI6zhsZ82o9GU-6HItxVq4BwlMW0ad0HZTXjGAhVf_t3hqKp4J8zV8kd0bQPPGRm8ALcG9HXX7JzBus4A6syP70GEfrwUPuqwDIHQBGz4w8yF8 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 0a97f689104e4884b6e30b0c8606b513 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesSnapshotTestJSON-559899765 May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:33:22.920295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0a97f689104e4884b6e30b0c8606b513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0a97f689104e4884b6e30b0c8606b513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a97f689104e4884b6e30b0c8606b513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a97f689104e4884b6e30b0c8606b513"}]}] May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesSnapshotTestJSON-559899765 May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 0a97f689104e4884b6e30b0c8606b513 May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-559899765 May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesSnapshotTestJSON-559899765-project May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6a658b1951a9426d94341940d87b5f95 May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesSnapshotTestJSON-559899765-project May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 850b5395-31f3-43e6-a549-fa9c33e66b7a could not be found. May 26 21:33:22.921849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '850b5395-31f3-43e6-a549-fa9c33e66b7a'} May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850b5395-31f3-43e6-a549-fa9c33e66b7a could not be found. May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:33:22.922611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850b5395-31f3-43e6-a549-fa9c33e66b7a could not be found. May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850b5395-31f3-43e6-a549-fa9c33e66b7a could not be found. May 26 21:33:22.923881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:33:22.925341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] Returning 404 to user: Instance 850b5395-31f3-43e6-a549-fa9c33e66b7a could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:33:22.925341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-616675e2-0328-49d8-a817-b8b5a32ccfc6 tempest-VolumesSnapshotTestJSON-559899765 tempest-VolumesSnapshotTestJSON-559899765-project] 10.222.0.42 "GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a" status: 404 len: 111 microversion: 2.1 time: 0.030357 May 26 21:33:22.925341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 406/769] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:22 2022] GET /compute/v2.1/servers/850b5395-31f3-43e6-a549-fa9c33e66b7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:33:23.058438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:23.059027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:23.065228 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:23.065679 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:23.067081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:23.067518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:23.194674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:23.202335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d21b1a47-3f53-45ee-a7f4-431abe57226e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.147704 May 26 21:33:23.202903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 364/770] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:23 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:24.219411 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:24.220087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:24.227024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:24.227468 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:24.228249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:24.228719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:24.359567 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:24.367097 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b69c47eb-c313-44cd-a694-8b293b38c70e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1259 microversion: 2.1 time: 0.151597 May 26 21:33:24.367656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 407/771] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:24 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:25.383610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:25.384150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:25.390850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:25.391299 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:25.392307 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:25.392851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:25.526272 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:25.533940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-62e055eb-660a-476c-aec7-14ed51830e3b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1443 microversion: 2.1 time: 0.154841 May 26 21:33:25.534602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 365/772] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:25 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:25.551219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:25.552450 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:25.558986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:25.559442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:25.560240 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:25.560678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:25.694105 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:25.702144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9d185524-57bd-45a7-80d6-70420610799a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1443 microversion: 2.1 time: 0.155057 May 26 21:33:25.708128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 408/773] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:25 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:33:27.632134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-158335b1-18e8-4b29-9f47-814aaa412cbd req-4c80bd8f-474d-4861-b67e-067a2ec31ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:33:27.643019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-158335b1-18e8-4b29-9f47-814aaa412cbd req-4c80bd8f-474d-4861-b67e-067a2ec31ec7 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:27.643019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-158335b1-18e8-4b29-9f47-814aaa412cbd req-4c80bd8f-474d-4861-b67e-067a2ec31ec7 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:27.652571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-158335b1-18e8-4b29-9f47-814aaa412cbd req-4c80bd8f-474d-4861-b67e-067a2ec31ec7 service nova] Creating event network-changed:5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a for instance 7586f603-aaac-433d-85db-77c2893aa328 on hv-cinder-82880 May 26 21:33:27.657889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-158335b1-18e8-4b29-9f47-814aaa412cbd req-4c80bd8f-474d-4861-b67e-067a2ec31ec7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030372 May 26 21:33:27.658513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 366/774] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:33:34.771946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c433cffb-d5ad-4e4c-b652-407a846b8be6"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:33:34.773106 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:34.774947 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=46 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:34.779851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:34.780302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:34.781059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:34.781520 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:35.598579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d79f30d8-f53c-426e-9ac9-e9a70195e1f0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930248 May 26 21:33:35.599349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 409/775] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:33:34 2022] POST /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:33:44.143391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:44.144204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:44.149143 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:33:44.150154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:44.156315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:44.156767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:44.157528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:44.157971 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:44.181350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'flavor' on Instance uuid 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:33:44.512273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-02d2a955-bd64-4bf6-8c4d-925d4752cfb3 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/action" status: 200 len: 32 microversion: 2.1 time: 0.370147 May 26 21:33:44.512887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 367/776] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:33:44 2022] POST /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:33:44.523463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:44.531276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:44.531276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:44.531276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:44.531676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:44.532071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:44.714392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:44.722731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4c581759-5b6e-4765-9b75-4babe075b16b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.204481 May 26 21:33:44.723324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 410/777] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:44 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:45.741207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:45.741899 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:45.748119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:45.748567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:45.749325 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:45.749754 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:45.880493 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:45.888426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9ba4d32b-50d0-421b-b5e1-04c4eb4a286a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.151983 May 26 21:33:45.889015 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 368/778] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:45 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:46.906236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:46.906885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:46.914065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:46.914519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:46.915282 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:46.915732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:47.046671 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:47.054894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-16f0f23a-67ac-4df6-9dbe-9084b06fe551 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.152636 May 26 21:33:47.055456 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 411/779] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:46 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:48.073168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:48.073774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:48.080328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:48.080794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:48.081540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:48.081974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:48.214760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:48.222823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e436d6a3-df5f-42ce-aebb-9e41a5d16e0b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.153505 May 26 21:33:48.223399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 369/780] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:48 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:49.241172 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:49.241808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:49.248836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:49.249284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:49.250051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:49.250493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:49.379822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:49.388613 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3c3bb0a6-1a88-48a2-b89d-3760150523fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.151893 May 26 21:33:49.389302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 412/781] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:49 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:50.405502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:50.406044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:50.412766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:50.413486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:50.414166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:50.414598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:50.547283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:50.555961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6c06b0e8-e4fb-47c0-a14e-d6cd733d0380 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.154580 May 26 21:33:50.563681 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 370/782] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:50 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:51.573339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:51.573958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:51.585354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:51.585880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:51.586684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:51.587189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:51.715754 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:51.724432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ccf61ba9-4c7c-47c8-a4be-a3ad747cd860 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.155798 May 26 21:33:51.725004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 413/783] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:51 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:52.741715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:52.742318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:52.748890 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:52.749282 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:52.750037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:52.750470 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:52.877702 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:52.886674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0ba92f38-7cb9-4ce3-807c-7aac749bd10e tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.148740 May 26 21:33:52.887291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 371/784] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:52 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:53.904169 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:53.904808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:53.911551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:53.912792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:53.912792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:53.913825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:54.101458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:54.109690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-21a8f04f-b87d-4f61-94c5-9a65e88205c7 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.209396 May 26 21:33:54.112610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 414/785] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:53 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:55.127411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:55.128231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:55.135432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:55.135919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:55.136722 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:55.137159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:55.283385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:55.291318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4ff816aa-8fa3-4f09-a6b0-877c3ac514f9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.167753 May 26 21:33:55.291909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 372/786] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:55 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:56.309092 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:56.309744 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:56.316412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:56.316810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:56.317579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:56.318021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:56.321341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:33:56.449844 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:56.457825 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c092239b-ac5f-4cb6-87ce-3439bdd10c81 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.152659 May 26 21:33:56.458394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 415/787] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:56 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:57.476539 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:57.477779 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:57.484854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:57.485313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:57.486086 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:57.486527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:57.616320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:57.624582 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f8a89f71-2dba-48ed-b823-950ef02b3d00 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.152594 May 26 21:33:57.625147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 373/788] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:57 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:58.641118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:58.641733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:58.648361 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:58.648816 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:58.649581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:58.650015 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:58.776677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:58.784124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b8df9676-a78e-432d-9709-1ff8856fecf4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.146924 May 26 21:33:58.784690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 416/789] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:58 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:33:59.801657 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:33:59.802258 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:33:59.809386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:59.809831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:59.810588 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:33:59.811020 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:33:59.939297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:33:59.947850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-57e80ef4-7783-4346-8ef1-18c8f2bf5e9c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.150406 May 26 21:33:59.948415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 374/790] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:33:59 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:00.965761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:00.966441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:00.972869 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:00.974214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:00.974214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:00.974482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:01.105608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:01.113687 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-14593b4f-bb5b-4e89-9002-c906a5501f73 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.152421 May 26 21:34:01.114254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 417/791] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:00 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:02.130406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:02.130946 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:02.137450 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:02.137895 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:02.138651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:02.139086 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:02.263476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:02.271594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6b226c36-54f1-461e-8113-1895282209c4 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.145074 May 26 21:34:02.272184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 375/792] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:02 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:03.289909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:03.294685 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:03.296893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:03.297342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:03.298099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:03.298800 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:03.432093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:03.440109 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8a79ae0c-16e4-492e-bd6f-222896a59850 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.154546 May 26 21:34:03.440709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 418/793] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:03 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:04.457234 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:04.457954 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:04.464918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:04.465373 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:04.466125 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:04.466557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:04.595566 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:04.603696 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-52bf028c-b5a7-4284-b217-4f12d292af56 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1736 microversion: 2.1 time: 0.150306 May 26 21:34:04.604323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 376/794] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:04 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:05.621662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:05.622274 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:05.624832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=20 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:05.629691 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:05.630142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:05.630954 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:05.631391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:05.758798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:05.766926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0ec7215a-3221-47fe-b35e-33428d778358 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1716 microversion: 2.1 time: 0.150084 May 26 21:34:05.767497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 419/795] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:05 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:05.871243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:05.871840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:05.878415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:05.878856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:05.879615 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:05.880067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:05.960696 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] HTTP exception thrown: Cannot 'detach_volume' instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 while it is in vm_state rescued May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Request method failure captured: May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments/c433cffb-d5ad-4e4c-b652-407a846b8be6 HTTP/1.1 May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_C0GQ-INvXduMwRGm3c4_grfgBDzDAf36288IjzTjUlGN5KOZEPTFz1tsu5su5_qXahLBmX-nMCklW5U-v5JAVsuvZ9bMUL1HpZ0TlBEfT1Z3537_WDj0yIeFhry6wX2_uaUprVJOTtyS2h_zAdtBoy5cowHpeB5CvHyF_ShVtbKrc May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 318999cb1f874176b2523de9686febc1 May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:34:05.962239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_318999cb1f874176b2523de9686febc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/318999cb1f874176b2523de9686febc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}] May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 318999cb1f874176b2523de9686febc1 May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: ee4307a7bdf84fe18efd6ba3dbe50c23 May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:34:05.963630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Cannot 'detach_volume' instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 while it is in vm_state rescued May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'server_id': '8cc04f2a-62bb-407b-b8d1-0e69eac279c2', 'id': 'c433cffb-d5ad-4e4c-b652-407a846b8be6'} May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:05.965210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 while it is in vm_state rescued May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 while it is in vm_state rescued May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:34:05.966723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Returning 409 to user: Cannot 'detach_volume' instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 while it is in vm_state rescued {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:05.967766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-346cb9ef-4fc2-4cf7-8004-838c0956dd14 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments/c433cffb-d5ad-4e4c-b652-407a846b8be6" status: 409 len: 152 microversion: 2.1 time: 0.097397 May 26 21:34:05.967766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 377/796] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:34:05 2022] DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments/c433cffb-d5ad-4e4c-b652-407a846b8be6 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 21:34:05.972594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:05.973126 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:05.979068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:05.979511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:05.980294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:05.980728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.237540 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4c00cc0a-9fa1-4150-a01e-a8dc2b20d13f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "POST /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/action" status: 202 len: 0 microversion: 2.1 time: 0.268442 May 26 21:34:06.238110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 420/797] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:34:05 2022] POST /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:34:06.247084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:06.247686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:06.254062 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.254507 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.258866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.258866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.415715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:06.427506 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-12ce1fe5-17f7-4b36-aa5b-3fa6d033981a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1724 microversion: 2.1 time: 0.185027 May 26 21:34:06.428128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 378/798] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:06 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:07.446799 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:07.447734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:07.453853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:07.454324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:07.455076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:07.455508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:07.587222 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:07.596254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4f8a9dcc-8055-46b3-8161-65f6602c6d8c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1724 microversion: 2.1 time: 0.154160 May 26 21:34:07.596901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 421/799] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:07 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:08.613875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:08.614434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:08.620921 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:08.621369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:08.622131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:08.622570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:08.750990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:08.759091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-af6d1885-ce1c-42ba-be84-8dd3883516f1 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1724 microversion: 2.1 time: 0.149180 May 26 21:34:08.759655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 379/800] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:08 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:09.158256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:09.159245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:09.166446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:09.166896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:09.167690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:09.168165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:09.420343 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0418c474-0ee2-4ec1-a53c-763e55aa6793 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/action" status: 202 len: 0 microversion: 2.1 time: 0.265690 May 26 21:34:09.420872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 422/801] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:34:09 2022] POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:34:09.429733 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:09.430401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:09.437162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:09.437635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:09.438399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:09.438838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:09.594287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:09.604961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a2554935-47dc-4f3b-9c5e-5703cbcef525 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1751 microversion: 2.1 time: 0.176992 May 26 21:34:09.604961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 380/802] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:09 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:09.777400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:09.778133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:09.784421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:09.784928 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:09.785703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:09.786144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:09.922900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:09.931822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ea7a9c74-8b1b-4304-9e99-ba20fa0a17b5 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1724 microversion: 2.1 time: 0.158709 May 26 21:34:09.932428 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 423/803] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:09 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:10.621736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:10.622347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:10.628491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:10.628948 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:10.629760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:10.630200 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:10.648835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:10.778847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:10.786833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4a031495-4f48-4eb4-958c-436db20817d8 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1751 microversion: 2.1 time: 0.169503 May 26 21:34:10.787401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 381/804] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:10 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:10.948282 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:10.948982 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:10.956050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:10.956602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:10.957380 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:10.957818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:11.091208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:11.099260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4198e07c-6e17-460a-b616-7b642c416cff tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1730 microversion: 2.1 time: 0.154922 May 26 21:34:11.099848 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 424/805] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:10 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:11.116775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:11.117266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:11.123963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:11.124416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:11.125179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:11.125617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:11.202215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-32102e89-2cf3-4d50-8475-0ccc07e4a8da tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089313 May 26 21:34:11.202840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 382/806] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:34:11 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:11.804970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:11.805582 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:11.811856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:11.812308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:11.813090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:11.813524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:12.274921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:12.283221 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-73b06089-f2df-436f-88ec-6bc6643afd2e tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.482093 May 26 21:34:12.284078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 425/807] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:11 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:12.447651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-347357c8-3952-407b-a2a1-b5c8d57d4b29 req-ac15e6c4-343b-4f03-8187-11bb3d2869fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc04f2a-62bb-407b-b8d1-0e69eac279c2", "tag": "7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:12.461703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-347357c8-3952-407b-a2a1-b5c8d57d4b29 req-ac15e6c4-343b-4f03-8187-11bb3d2869fc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:12.465584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-347357c8-3952-407b-a2a1-b5c8d57d4b29 req-ac15e6c4-343b-4f03-8187-11bb3d2869fc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:12.474096 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-347357c8-3952-407b-a2a1-b5c8d57d4b29 req-ac15e6c4-343b-4f03-8187-11bb3d2869fc service nova] Creating event network-changed:7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9 for instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 on hv-cinder-82880 May 26 21:34:12.479762 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-347357c8-3952-407b-a2a1-b5c8d57d4b29 req-ac15e6c4-343b-4f03-8187-11bb3d2869fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036830 May 26 21:34:12.480374 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 383/808] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:13.301877 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:13.302514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:13.309748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:13.310197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:13.310964 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:13.311397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:13.451559 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:13.460071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-87fb3553-0863-4e1c-bfe1-4e5dfd8ed263 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.162243 May 26 21:34:13.460661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 426/809] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:13 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:14.478231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:14.478915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:14.481063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=35 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:14.486363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:14.486819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:14.487653 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:14.488115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:14.493956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-b55e9079-dff2-4c05-9c38-3c55abe7c154 req-b05bace3-499f-4070-8fa0-358031792f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc04f2a-62bb-407b-b8d1-0e69eac279c2", "tag": "7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:14.502996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-b55e9079-dff2-4c05-9c38-3c55abe7c154 req-b05bace3-499f-4070-8fa0-358031792f6f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:14.503438 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-b55e9079-dff2-4c05-9c38-3c55abe7c154 req-b05bace3-499f-4070-8fa0-358031792f6f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:14.515611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-b55e9079-dff2-4c05-9c38-3c55abe7c154 req-b05bace3-499f-4070-8fa0-358031792f6f service nova] Creating event network-changed:7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9 for instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 on hv-cinder-82880 May 26 21:34:14.520784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-b55e9079-dff2-4c05-9c38-3c55abe7c154 req-b05bace3-499f-4070-8fa0-358031792f6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030705 May 26 21:34:14.521376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 427/810] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:34:14.637662 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:14.645815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-841e409c-6fea-479c-8a41-c1495197cb46 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.172384 May 26 21:34:14.646383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 384/811] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:14 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:15.664641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:15.665351 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:15.672743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:15.673449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:15.674238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:15.674678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:15.814553 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:15.822984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b8a9000f-d540-449d-b011-39229e80cc32 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.162683 May 26 21:34:15.823546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 428/812] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:15 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:16.841348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:16.841953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:16.848055 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:16.848504 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:16.849275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:16.849707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:17.002529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:17.011131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1f3fb01f-de0d-450e-aaae-ca05fbb0e976 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.174986 May 26 21:34:17.011701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 385/813] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:16 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:18.028880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:18.029453 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:18.035486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:18.035963 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:18.036721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:18.037155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:18.181694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:18.189743 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2f6e9fbc-2e6d-4e4d-b7ed-b01f0e459683 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.165584 May 26 21:34:18.190306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 429/814] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:18 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:19.207408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:19.208033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:19.214159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:19.214602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:19.215351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:19.215800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:19.357195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:19.365214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ad286b59-31a7-439c-a1fe-5605a75b47e9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.161653 May 26 21:34:19.365775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 386/815] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:19 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:20.382383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:20.382983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:20.390182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:20.390635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:20.391458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:20.391930 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:20.407420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:20.533553 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:20.541548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-28d6b2ae-4703-4b01-809e-3d96e197565a tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.163019 May 26 21:34:20.542110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 430/816] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:20 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:21.558371 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:21.558975 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:21.566108 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:21.566564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:21.567343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:21.567797 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:21.716149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:21.724188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-df6aad49-e3d1-4ed8-997e-415ed5a227c6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1756 microversion: 2.1 time: 0.169703 May 26 21:34:21.724759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 387/817] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:21 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:22.741873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:22.742612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:22.749961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:22.750413 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:22.751180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:22.751623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:22.905722 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:22.914020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c000c392-2208-4e05-95a8-f6aeac329764 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1759 microversion: 2.1 time: 0.175993 May 26 21:34:22.914602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 431/818] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:22 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:32.980986 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:32.981515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:32.983837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=7 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:32.984492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=32 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:32.989276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:32.995162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:32.995162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:32.995162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.014527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-29248f89-3971-4acf-9d1d-6d2b6ea55414 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/ips" status: 200 len: 149 microversion: 2.1 time: 0.037475 May 26 21:34:33.015085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 388/819] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:34:32 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:33.025898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1def128d-7755-4ccb-89aa-8ab3743dae03"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:33.027772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:33.030214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=25 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:33.030966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=9 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:33.035922 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:33.036384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.037156 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:33.037595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.116699 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Invalid volume: volume 1def128d-7755-4ccb-89aa-8ab3743dae03 is already attached to instances: 94bec145-b7bb-413b-a4ee-124c14212c63 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: POST /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/os-volume_attachments HTTP/1.1 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 74 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:34:33.118901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {"volumeAttachment": {"volumeId": "1def128d-7755-4ccb-89aa-8ab3743dae03"}} May 26 21:34:33.120629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Invalid volume: volume 1def128d-7755-4ccb-89aa-8ab3743dae03 is already attached to instances: 94bec145-b7bb-413b-a4ee-124c14212c63 May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'server_id': 'f47b8242-7a18-4ea5-b647-3ac7c275bdab', 'body': {'volumeAttachment': {'volumeId': '1def128d-7755-4ccb-89aa-8ab3743dae03'}}} May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1def128d-7755-4ccb-89aa-8ab3743dae03 is already attached to instances: 94bec145-b7bb-413b-a4ee-124c14212c63 May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:33.121522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1def128d-7755-4ccb-89aa-8ab3743dae03 is already attached to instances: 94bec145-b7bb-413b-a4ee-124c14212c63 May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:33.122969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1def128d-7755-4ccb-89aa-8ab3743dae03 is already attached to instances: 94bec145-b7bb-413b-a4ee-124c14212c63 May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 400 to user: Invalid volume: volume 1def128d-7755-4ccb-89aa-8ab3743dae03 is already attached to instances: 94bec145-b7bb-413b-a4ee-124c14212c63 {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8035575a-2c9b-4d56-8081-566f9ff93c42 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098507 May 26 21:34:33.124527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 432/820] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:34:33 2022] POST /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:34:33.129849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:33.130342 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:33.137150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:33.137646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.138413 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:33.138852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.163549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:34:33.397372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-349ff636-14ae-4ac1-8af7-15d589a983ae tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 204 len: 0 microversion: 2.1 time: 0.271783 May 26 21:34:33.398073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 389/821] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:34:33 2022] DELETE /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:34:33.406302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:33.407643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:33.413217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:33.413661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.414417 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:33.415589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:33.544577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:33.552318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fdc84742-d67a-41ab-a025-46e505da7f7c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1680 microversion: 2.1 time: 0.149989 May 26 21:34:33.552875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 433/822] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:33 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:34.572139 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:34.572832 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:34.579914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:34.580363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:34.581129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:34.581561 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:34.713103 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:34.721270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c12b50aa-9667-433a-8d83-042a72c5e9d7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1680 microversion: 2.1 time: 0.153465 May 26 21:34:34.721827 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 390/823] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:34 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:35.738205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:35.738817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:35.745550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:35.746000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:35.746826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:35.747261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.021370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:36.030121 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ddf00a2d-6e84-48fa-a678-9b263c81941b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1680 microversion: 2.1 time: 0.295709 May 26 21:34:36.030700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 434/824] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:35 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:36.400452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:36.401021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:36.408183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.408635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.409592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.409896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.440904 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-64f434db-e465-427c-b92f-4ede9719865d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments/ceffa45c-1a64-4afe-86c6-a8c240d01f6a" status: 200 len: 194 microversion: 2.20 time: 0.044615 May 26 21:34:36.446757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 391/825] 10.222.0.42 () {60 vars in 1453 bytes} [Thu May 26 21:34:36 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments/ceffa45c-1a64-4afe-86c6-a8c240d01f6a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:34:36.511698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:36.511698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:36.517221 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.517677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.518474 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.518917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.572101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-5d3539c2-9356-4a6e-8cd0-4d595c9246e9 req-e9c55b97-120a-4e90-8226-ac60c8b90c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47b8242-7a18-4ea5-b647-3ac7c275bdab", "name": "network-vif-deleted", "tag": "3ee57c28-7886-4588-b610-9158fcb5e1b2"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:36.582398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5d3539c2-9356-4a6e-8cd0-4d595c9246e9 req-e9c55b97-120a-4e90-8226-ac60c8b90c88 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.582639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5d3539c2-9356-4a6e-8cd0-4d595c9246e9 req-e9c55b97-120a-4e90-8226-ac60c8b90c88 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.595345 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-5d3539c2-9356-4a6e-8cd0-4d595c9246e9 req-e9c55b97-120a-4e90-8226-ac60c8b90c88 service nova] Creating event network-vif-deleted:3ee57c28-7886-4588-b610-9158fcb5e1b2 for instance f47b8242-7a18-4ea5-b647-3ac7c275bdab on hv-cinder-82880 May 26 21:34:36.603690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-5d3539c2-9356-4a6e-8cd0-4d595c9246e9 req-e9c55b97-120a-4e90-8226-ac60c8b90c88 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 May 26 21:34:36.603690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 392/826] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:34:36.645491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lazy-loading 'services' on Instance uuid 73c36399-8b1a-4b08-b284-8a3900a10d73 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:36.900657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f0f81848-38f8-4ef6-8053-f25ded91d320 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments/ceffa45c-1a64-4afe-86c6-a8c240d01f6a" status: 202 len: 0 microversion: 2.20 time: 0.394439 May 26 21:34:36.901552 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 435/827] 10.222.0.42 () {60 vars in 1456 bytes} [Thu May 26 21:34:36 2022] DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments/ceffa45c-1a64-4afe-86c6-a8c240d01f6a => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:34:36.911122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:36.912262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:36.920729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.921487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.922477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:36.923360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:36.955348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0734dd6b-a8cb-497a-9060-52ddc85b34e6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048748 May 26 21:34:36.956283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 393/828] 10.222.0.42 () {60 vars in 1342 bytes} [Thu May 26 21:34:36 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:34:37.047637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:37.048696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:37.055593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:37.056083 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:37.056863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:37.057306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:37.090100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:37.090553 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:37.091011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'fault' on Instance uuid f47b8242-7a18-4ea5-b647-3ac7c275bdab {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:37.135972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:37.145281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-67d2af2b-d2e5-4726-aee7-1ff0606b1fb1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 200 len: 1330 microversion: 2.1 time: 0.102500 May 26 21:34:37.156899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 436/829] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:37 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:37.966959 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:37.968047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:37.975173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:37.975711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:37.976593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:37.977195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:38.011999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b1206034-e1c3-4f5f-b4cd-e5604a012bcf tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049125 May 26 21:34:38.012782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 394/830] 10.222.0.42 () {60 vars in 1342 bytes} [Thu May 26 21:34:37 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:34:38.162563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:38.163165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:38.170303 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:38.170750 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:38.171513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:38.171977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:38.186346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab HTTP/1.1 May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:34:38.188010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:34:38.189287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': 'f47b8242-7a18-4ea5-b647-3ac7c275bdab'} May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:38.190033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:34:38.191233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:38.192367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:38.192367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b2ce3e7a-865e-45ed-8a40-5974a6f3ae31 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 404 len: 111 microversion: 2.1 time: 0.030864 May 26 21:34:38.192367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 437/831] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:38 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:34:38.198185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3d3d50cd-a1d7-4f09-8482-8c2490c25922 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '.version_select at 0x7f7bc4b464c0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:38.266885 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3d3d50cd-a1d7-4f09-8482-8c2490c25922 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619979787" status: 202 len: 0 microversion: 2.1 time: 0.072290 May 26 21:34:38.267383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 395/832] 10.222.0.42 () {58 vars in 1217 bytes} [Thu May 26 21:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619979787 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:34:39.025021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:39.025996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:39.032475 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.032865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.033698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.034136 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.065726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-66927482-5cbc-4df4-aad8-6b84f2b5f8dd tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044720 May 26 21:34:39.066494 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 438/833] 10.222.0.42 () {60 vars in 1342 bytes} [Thu May 26 21:34:39 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:39.149603 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:39.150822 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:39.160239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.160691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.161679 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.162128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.190876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:34:39.211261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:39.211778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:39.218121 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.218524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.219300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.219994 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.303305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'services' on Instance uuid 94bec145-b7bb-413b-a4ee-124c14212c63 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:39.541732 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8aae9889-d439-4042-a04a-48aa22445645 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 204 len: 0 microversion: 2.20 time: 0.396051 May 26 21:34:39.542239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 396/834] 10.222.0.42 () {60 vars in 1279 bytes} [Thu May 26 21:34:39 2022] DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 21:34:39.551823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:39.552550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:39.559072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.559522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.560369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.560826 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.586798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5ae5573a-13c4-4d3a-98f1-90ebd8e1627e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments/1def128d-7755-4ccb-89aa-8ab3743dae03" status: 202 len: 0 microversion: 2.1 time: 0.377933 May 26 21:34:39.598609 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 439/835] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:34:39 2022] DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments/1def128d-7755-4ccb-89aa-8ab3743dae03 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:34:39.608631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:39.609734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:39.617746 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.620936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.620936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:39.620936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:39.657804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-21eb59bc-58ca-42be-a0d4-9bc85067e115 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054482 May 26 21:34:39.658384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 440/836] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:34:39 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:39.717575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:39.726481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:39.728058 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:39.729309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f7c5ee45-08f4-4da0-9884-6c8be0fad101 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.182067 May 26 21:34:39.730027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 397/837] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:39 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:34:40.670230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:40.671174 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:40.678008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:40.678441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:40.679213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:40.679650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:40.709764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-98f50cf3-4c90-4961-baac-d38f38bd60fa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044049 May 26 21:34:40.710334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 441/838] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:34:40 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:40.748733 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:40.749420 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:40.755884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:40.756332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:40.757116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:40.757548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:40.883310 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:40.893812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:40.895513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:40.896711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fec703e4-15fa-48b6-81b9-a63d4053eb89 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.152564 May 26 21:34:40.897477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 398/839] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:40 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:41.722169 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:41.724554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:41.729459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:41.729915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:41.730698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:41.731136 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:41.763176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-639b7f2c-9d8b-44c9-83a4-bdea8794a086 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 May 26 21:34:41.763790 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 442/840] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:34:41 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:41.914583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:41.915266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:41.921828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:41.922281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:41.923314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:41.923765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:42.056307 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:42.064828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:42.066351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:42.067509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-58ccb75e-3f37-483f-8719-31003e021dc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1723 microversion: 2.20 time: 0.156972 May 26 21:34:42.068121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 399/841] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:41 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:42.564404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-3c729f88-4aef-4f06-9864-e734f1d646ba req-eae52684-e93e-4269-976d-6e884611e186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c36399-8b1a-4b08-b284-8a3900a10d73", "name": "network-vif-deleted", "tag": "f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:42.572777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-3c729f88-4aef-4f06-9864-e734f1d646ba req-eae52684-e93e-4269-976d-6e884611e186 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:42.573319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-3c729f88-4aef-4f06-9864-e734f1d646ba req-eae52684-e93e-4269-976d-6e884611e186 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:42.585719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-3c729f88-4aef-4f06-9864-e734f1d646ba req-eae52684-e93e-4269-976d-6e884611e186 service nova] Creating event network-vif-deleted:f6acaa12-aa4c-45e5-8cb0-5ebdb1fec91f for instance 73c36399-8b1a-4b08-b284-8a3900a10d73 on hv-cinder-82880 May 26 21:34:42.590709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-3c729f88-4aef-4f06-9864-e734f1d646ba req-eae52684-e93e-4269-976d-6e884611e186 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 May 26 21:34:42.591315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 443/842] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:42.774666 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:42.775648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:42.782547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:42.783048 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:42.783869 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:42.784304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:42.815097 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a03ebe53-8274-4cda-92ee-386013a36e04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044370 May 26 21:34:42.815659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 400/843] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:34:42 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:34:42.882349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:42.883333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:42.890404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:42.890863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:42.891646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:42.892133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:42.921135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:34:43.086490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:43.087105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:43.095236 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:43.095806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:43.096674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:43.097124 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:43.128335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:43.128789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:43.129246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lazy-loading 'fault' on Instance uuid 73c36399-8b1a-4b08-b284-8a3900a10d73 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:43.178132 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:43.186604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:43.188173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:43.189321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3e1f928f-8577-4470-b140-774c67a431c9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 200 len: 1371 microversion: 2.20 time: 0.106806 May 26 21:34:43.189883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 401/844] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:43 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:43.238637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8d8cbd27-acb3-4887-9ef7-8387ab2bdd18 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 204 len: 0 microversion: 2.1 time: 0.360957 May 26 21:34:43.239302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 444/845] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:34:42 2022] DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:34:43.248774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:43.249715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:43.256958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:43.257417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:43.258233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:43.258676 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:43.397474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:43.401205 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:43.406608 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0e8c7e04-70f5-4348-a681-deb1060ecf59 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1681 microversion: 2.1 time: 0.163091 May 26 21:34:43.407269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 402/846] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:43 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:44.208962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:44.209765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:44.216292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:44.216749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:44.217517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:44.217954 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:44.231633 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] HTTP exception thrown: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Request method failure captured: May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 HTTP/1.1 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_CpJcnQs6qrgIsxkNWYrsxgO62o8ujaIA1G-yytFj1e5mQJJIyoN3-pPMrZVaWAlIUG1AZiGgdfUBXYWu_m3f23zWTOmzCfgbzLieYfspNt9wecjkAbjzmgX3S3YZDvWTvtPDh0DCEe3mAt2TeKt41RsLn8T48Vr4f1Y7z8WE8SVYE May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: c5f69588fe354d20b58594919deb4110 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:34:44.233360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5f69588fe354d20b58594919deb4110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5f69588fe354d20b58594919deb4110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}] May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: c5f69588fe354d20b58594919deb4110 May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 9b94748ea78342629281f2360a54bee4 May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:34:44.235072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '73c36399-8b1a-4b08-b284-8a3900a10d73'} May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:44.236034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:34:44.237536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:44.238845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Returning 404 to user: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:44.238845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-96c41171-653e-4792-aa29-185612b3a652 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 404 len: 111 microversion: 2.20 time: 0.030131 May 26 21:34:44.238845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 445/847] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:44 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:34:44.248613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b1eb6b18-cee7-4ac1-92d4-581087609c4c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '.version_select at 0x7f7bc4c3c8b0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:44.377259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b1eb6b18-cee7-4ac1-92d4-581087609c4c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027092613" status: 204 len: 0 microversion: 2.20 time: 0.133349 May 26 21:34:44.377975 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 403/848] 10.222.0.42 () {60 vars in 1261 bytes} [Thu May 26 21:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027092613 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 21:34:44.426115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:44.427728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:44.437523 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:44.438479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:44.439287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:44.440700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:44.921896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:44.930448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-12106fcd-609b-48aa-a08e-3693feaa95f9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1681 microversion: 2.1 time: 0.509853 May 26 21:34:44.931318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 446/849] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:44 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1681 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:45.178910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-00aab9f9-f2a6-45d3-82bc-a4e1ee430e39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'create', calling method: .version_select at 0x7f7bc4c0cdc0>, body: {"keypair": {"name": "tempest-keypair-1498945762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKryB0b5yB4fJuq24hafOcXqFTnKXx1AjIziOY4Cv5GKndGou+r+8e5CzVjkeTo7hIZQfd+xXdBEi5qVgbE85F/JxoKI3cZWjV+iLxE74ccdNqjpxNcuCt0ek85r21oy3g=="}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:45.194361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-00aab9f9-f2a6-45d3-82bc-a4e1ee430e39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for project c5f69588fe354d20b58594919deb4110. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:34:45.198224 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-00aab9f9-f2a6-45d3-82bc-a4e1ee430e39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for user 9b94748ea78342629281f2360a54bee4 and project c5f69588fe354d20b58594919deb4110. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:34:45.291573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-00aab9f9-f2a6-45d3-82bc-a4e1ee430e39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.116917 May 26 21:34:45.292246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 404/850] 10.222.0.42 () {62 vars in 1199 bytes} [Thu May 26 21:34:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 21:34:45.388925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-802a9890-4962-4c7e-9261-bc07d25b5eaa req-e18c1fa9-6b17-4909-8023-43794818dadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bec145-b7bb-413b-a4ee-124c14212c63", "name": "network-vif-deleted", "tag": "2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:45.400599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-802a9890-4962-4c7e-9261-bc07d25b5eaa req-e18c1fa9-6b17-4909-8023-43794818dadc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:45.401705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-802a9890-4962-4c7e-9261-bc07d25b5eaa req-e18c1fa9-6b17-4909-8023-43794818dadc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:45.409106 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:45.417092 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-802a9890-4962-4c7e-9261-bc07d25b5eaa req-e18c1fa9-6b17-4909-8023-43794818dadc service nova] Creating event network-vif-deleted:2ef3e07e-63f8-4d2c-a2df-fb1c2a09ec5e for instance 94bec145-b7bb-413b-a4ee-124c14212c63 on hv-cinder-82880 May 26 21:34:45.423175 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-802a9890-4962-4c7e-9261-bc07d25b5eaa req-e18c1fa9-6b17-4909-8023-43794818dadc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037722 May 26 21:34:45.424688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 447/851] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:45.837604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:45.841512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:45.845977 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:45.846673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:45.847485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:45.847947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:45.878549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:34:45.948949 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:45.949672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:45.957616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:45.958068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:45.958852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:45.959293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:45.991480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:45.992183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:45.992797 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'fault' on Instance uuid 94bec145-b7bb-413b-a4ee-124c14212c63 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:46.037801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:46.045940 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8aeb8971-4341-495b-8e9c-9f8a7b923db7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1332 microversion: 2.1 time: 0.101295 May 26 21:34:46.046514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 448/852] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:45 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:46.204965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-203d0c8a-7e96-495d-899a-31a8c4ebf609 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 204 len: 0 microversion: 2.1 time: 0.599911 May 26 21:34:46.209310 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 405/853] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:34:45 2022] DELETE /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:34:46.214521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:46.215147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:46.222325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:46.222792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:46.223633 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:46.224423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:46.376063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:46.383698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ed2214da-962e-4aca-b296-1c6778f38578 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1577 microversion: 2.1 time: 0.173329 May 26 21:34:46.384326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 449/854] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:46 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:47.064542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:47.065227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:47.071655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:47.072135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:47.072896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:47.073330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:47.104180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:47.104632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:47.105077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'fault' on Instance uuid 94bec145-b7bb-413b-a4ee-124c14212c63 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:47.149613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:47.158058 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7bd31db2-067f-45cb-9791-07ce5945f00e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 200 len: 1332 microversion: 2.1 time: 0.098372 May 26 21:34:47.158499 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 406/855] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:47 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:47.402354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:47.403030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:47.410576 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:47.411021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:47.411818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:47.412255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:47.614988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:47.622885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-24b67b3c-6172-490e-9fa4-23999a606e22 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1577 microversion: 2.1 time: 0.224846 May 26 21:34:47.623451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 450/856] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:47 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:47.930036 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2114381114", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea9ef1f2-5514-49f0-be2f-c0970bb75a74"}], "security_groups": [{"name": "tempest-securitygroup--657094549"}], "key_name": "tempest-keypair-1498945762", "user_data": "}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:48.030891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] validate_networks() for [('ea9ef1f2-5514-49f0-be2f-c0970bb75a74', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:34:48.177238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:48.178849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:48.188700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:48.189387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:48.190615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:48.191350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:48.210703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 HTTP/1.1 May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:34:48.212906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:34:48.214556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '94bec145-b7bb-413b-a4ee-124c14212c63'} May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:48.215372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:34:48.216976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:48.218342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:48.218342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b28d03ce-1c1b-4b1d-805d-74f98721395d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 404 len: 111 microversion: 2.1 time: 0.043805 May 26 21:34:48.218342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 451/857] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:48 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:34:48.228082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9146b866-1e45-4fbb-a917-57163a76c07a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '.version_select at 0x7f7bc5560550>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:48.348695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9146b866-1e45-4fbb-a917-57163a76c07a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921783376" status: 202 len: 0 microversion: 2.1 time: 0.124889 May 26 21:34:48.349575 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 452/858] 10.222.0.42 () {58 vars in 1220 bytes} [Thu May 26 21:34:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921783376 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:34:48.460721 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:34:48.461791 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:34:48.462359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:34:48.462834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:34:48.463400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:34:48.473990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:48.478130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:48.478130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:48.478130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:48.493576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for project c5f69588fe354d20b58594919deb4110. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:34:48.498215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Getting quotas for user 9b94748ea78342629281f2360a54bee4 and project c5f69588fe354d20b58594919deb4110. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:34:48.511294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:34:48.514250 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:34:48.640504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:48.641371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:48.650919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:48.656536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:48.656536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:48.656536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:48.695126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1fc73a86-730c-4f0b-a448-856596a8b272 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.769371 May 26 21:34:48.696137 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 407/859] 10.222.0.42 () {62 vars in 1187 bytes} [Thu May 26 21:34:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 21:34:48.706969 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c24b3126-67ea-42bf-9f5a-7ca53c0296d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:48.707888 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c24b3126-67ea-42bf-9f5a-7ca53c0296d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:48.763574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:48.772087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6057014d-7ec3-495f-927f-3d8613d1d205 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1510 microversion: 2.1 time: 0.135998 May 26 21:34:48.773081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 453/860] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:48 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1510 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:48.777655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c24b3126-67ea-42bf-9f5a-7ca53c0296d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:48.786836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c24b3126-67ea-42bf-9f5a-7ca53c0296d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:48.788698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c24b3126-67ea-42bf-9f5a-7ca53c0296d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:48.791373 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c24b3126-67ea-42bf-9f5a-7ca53c0296d2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1282 microversion: 2.20 time: 0.088004 May 26 21:34:48.796530 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 408/861] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:48 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:34:49.128413 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-1f469760-ed99-44d7-b8a6-f1b71f65fa6e req-4f93ad96-3896-42ca-a1c6-b8e212a05a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e2b4ade-df77-4c06-bfc0-2a510bfe37d5", "name": "network-vif-deleted", "tag": "1faef2ef-eecc-4157-ac0a-913c45525b24"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:49.150022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1f469760-ed99-44d7-b8a6-f1b71f65fa6e req-4f93ad96-3896-42ca-a1c6-b8e212a05a1f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:49.150737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1f469760-ed99-44d7-b8a6-f1b71f65fa6e req-4f93ad96-3896-42ca-a1c6-b8e212a05a1f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:49.163544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-1f469760-ed99-44d7-b8a6-f1b71f65fa6e req-4f93ad96-3896-42ca-a1c6-b8e212a05a1f service nova] Creating event network-vif-deleted:1faef2ef-eecc-4157-ac0a-913c45525b24 for instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 on hv-cinder-82880 May 26 21:34:49.171252 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-1f469760-ed99-44d7-b8a6-f1b71f65fa6e req-4f93ad96-3896-42ca-a1c6-b8e212a05a1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046381 May 26 21:34:49.172434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 454/862] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:49.447272 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-92afcb33-c6c8-4040-b23d-52d698650526 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: .version_select at 0x7f7bc4b06670>, body: {"keypair": {"name": "tempest-keypair-751665930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcJvs3oMRqA4ob+eb3d55gbeiF0hN0DVzYaQo05l+7VoyMcpyQxQ7TdGhfvChuVaOLmPoT3jLDyap4wrNKYPG7VLTwWwasjNjbL5AmgaHkkTTeN5waEX1JzxDV2nXpPCQ=="}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:49.460806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:49.465687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-92afcb33-c6c8-4040-b23d-52d698650526 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:34:49.470221 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-92afcb33-c6c8-4040-b23d-52d698650526 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:34:49.607938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-92afcb33-c6c8-4040-b23d-52d698650526 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164052 May 26 21:34:49.609369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 409/863] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:34:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:49.791281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:49.792715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:49.808263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:49.811448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:49.812182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:49.815482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:49.819660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:49.820902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:49.821424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:49.824111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:49.827081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:49.827637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:49.860341 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:49.860673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:49.861182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lazy-loading 'fault' on Instance uuid 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:49.901817 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:49.910041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:49.911793 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:49.912729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d5feff9d-d041-4dc7-b6df-91f566db65eb tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1286 microversion: 2.20 time: 0.106887 May 26 21:34:49.913787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 410/864] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:49 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:34:49.917544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:49.928446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4fa619d9-75b8-47cd-b3ad-72f095cc824d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 200 len: 1229 microversion: 2.1 time: 0.141965 May 26 21:34:49.929042 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 455/865] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:49 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 1229 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:50.933141 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:50.935132 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:50.950554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:50.951726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:50.953496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:50.954339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:50.959228 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:50.959910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:50.974157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:50.974815 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:50.975650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:50.976208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:50.995060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] HTTP exception thrown: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Request method failure captured: May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 HTTP/1.1 May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_EgJ2FHpPbSPISU30Rq3PmZJwaeAo3qDERSSArI9eZNKjmGn9TE9UKE7HIwXbNFpU_tNkW8Rx6p3e0udsgCyvGbEOkh8aXh90-xuZu1sMB8ZZOSGBhsXR3TwEc4YL9LNnJL_UvcXOkPFSZLZjFcZzya8jDxKrfstz8ZNap5XXCtaqA May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:34:51.004226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}] May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-TestVolumeBootPattern-1024582870 May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-TestVolumeBootPattern-1024582870-project May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 88575c0bd9db4fa8bc9bd511c0ac37dd May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-TestVolumeBootPattern-1024582870-project May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:34:51.005919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '3e2b4ade-df77-4c06-bfc0-2a510bfe37d5'} May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:51.006868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:34:51.008238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:34:51.009473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Returning 404 to user: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:51.009473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-83ccc3ac-61ec-480e-a04a-bd7ee98872c1 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 404 len: 111 microversion: 2.1 time: 0.056840 May 26 21:34:51.009473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 456/866] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:50 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:34:51.055792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:51.074452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:51.076050 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:51.077163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6eb59b60-358c-4632-b8bc-539153087a21 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1342 microversion: 2.20 time: 0.149433 May 26 21:34:51.079805 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 411/867] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:50 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1342 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:51.121350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-506317118", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-80832212", "security_groups": [{"name": "tempest-secgroup-smoke-389140089"}], "block_device_mapping_v2": [{"uuid": "4feb4aae-232c-4d1d-8581-1c1bd4afe4c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e9f896ed-3367-41b4-ace5-9c753fe1f6ff"}]}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:51.591773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] validate_networks() for [('e9f896ed-3367-41b4-ace5-9c753fe1f6ff', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:34:52.099510 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:52.100235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:52.106713 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:52.107232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:52.108022 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:52.108459 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:52.325341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:52.329979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:34:52.330952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:34:52.331501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:34:52.332147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:34:52.332752 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:34:52.334126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:52.335642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:52.336982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d60155d8-c4de-4e0f-b881-b66b9ccdb5f2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1340 microversion: 2.20 time: 0.242258 May 26 21:34:52.348169 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 412/868] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:52 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1340 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:34:52.348369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:52.348369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:52.348369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:52.348369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:52.361571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:34:52.365746 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for user 88575c0bd9db4fa8bc9bd511c0ac37dd and project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:34:52.432622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:34:52.434719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4feb4aae-232c-4d1d-8581-1c1bd4afe4c3',volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:34:52.931257 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-98564cb7-61ad-4b3a-94d9-40f8d8522ae0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.815099 May 26 21:34:52.931947 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 457/869] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:34:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:34:52.942655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d28014be-c959-46b4-9bc0-97dfac8bec21 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:52.943314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d28014be-c959-46b4-9bc0-97dfac8bec21 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:53.008409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d28014be-c959-46b4-9bc0-97dfac8bec21 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:53.016661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d28014be-c959-46b4-9bc0-97dfac8bec21 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1092 microversion: 2.1 time: 0.077731 May 26 21:34:53.017225 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 413/870] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:52 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1092 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:53.064463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2031781043", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e423d8c6-f848-40d6-99bb-c61a958058f7"}], "security_groups": [{"name": "tempest-securitygroup--75697263"}], "key_name": "tempest-keypair-751665930", "user_data": "}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:53.248326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] validate_networks() for [('e423d8c6-f848-40d6-99bb-c61a958058f7', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:34:53.356913 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:53.357468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:53.365142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:53.365864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:53.366819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:53.367261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:53.507711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:53.517525 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:53.519113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:53.520257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8979fa90-f78c-4d0f-97f6-a367d8318406 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.167316 May 26 21:34:53.520823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 414/871] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:53 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:53.755195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:34:53.755711 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:34:53.756182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:34:53.756620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:34:53.757036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:34:53.765980 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:53.766430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:53.767402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:53.768067 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:53.791319 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:34:53.798370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:34:53.814965 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:34:53.818019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:34:53.848382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:53.964208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3b6f950b-b109-4eeb-bc18-789bbc01b5cd tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.903944 May 26 21:34:53.965554 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 458/872] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:34:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:34:53.975734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1607bd0a-4b35-407a-a116-b5688c5e3048 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:53.976772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1607bd0a-4b35-407a-a116-b5688c5e3048 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:54.037924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:54.037924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:54.051772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1607bd0a-4b35-407a-a116-b5688c5e3048 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:54.055005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:54.056215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:54.056741 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:54.057312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:54.062660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1607bd0a-4b35-407a-a116-b5688c5e3048 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1241 microversion: 2.1 time: 0.090619 May 26 21:34:54.063226 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 415/873] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:53 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:54.159769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-11c9dcf7-7b2e-4c6d-8ae3-a1f20f2475d8 req-72af458f-8bbf-463e-b3de-af3fa15b9212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:54.163114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:54.175432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-11c9dcf7-7b2e-4c6d-8ae3-a1f20f2475d8 req-72af458f-8bbf-463e-b3de-af3fa15b9212 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:54.175836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-44dae94b-fc02-4f32-bb96-6e7f912230de tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1142 microversion: 2.1 time: 0.145846 May 26 21:34:54.176565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-11c9dcf7-7b2e-4c6d-8ae3-a1f20f2475d8 req-72af458f-8bbf-463e-b3de-af3fa15b9212 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:54.177712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 459/874] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:54 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1142 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:54.202645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-11c9dcf7-7b2e-4c6d-8ae3-a1f20f2475d8 req-72af458f-8bbf-463e-b3de-af3fa15b9212 service nova] Creating event network-changed:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:34:54.208136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-11c9dcf7-7b2e-4c6d-8ae3-a1f20f2475d8 req-72af458f-8bbf-463e-b3de-af3fa15b9212 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052101 May 26 21:34:54.208766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 416/875] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:34:54.537976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:54.538628 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:54.545422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:54.545837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:54.546615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:54.547050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:54.686900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:54.694956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:54.696508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:54.697697 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b927cde0-35c0-4341-aedf-92847fba88c3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.163627 May 26 21:34:54.698262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 460/876] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:54 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:55.083091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:55.084909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:55.094727 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:55.095465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:55.096378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:55.096819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:55.178435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:55.186601 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ee7481d9-af24-4bec-ba2f-e7ac081cea2e tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1245 microversion: 2.1 time: 0.111015 May 26 21:34:55.188261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 417/877] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:55 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:55.194605 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:55.195211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:55.202547 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:55.202984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:55.203784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:55.204228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:55.271833 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:55.280019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-89101535-77a5-4514-a721-cf8cfa81663e tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1198 microversion: 2.1 time: 0.089294 May 26 21:34:55.280600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 461/878] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:55 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:55.716040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:55.717154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:55.723291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:55.723734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:55.724531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:55.724967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:55.950378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:55.959189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:55.960749 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:55.961858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8a5cc870-8202-4fc0-a462-5185aaabad39 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.249814 May 26 21:34:55.962430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 418/879] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:55 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:56.203857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:56.204934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:56.211410 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:56.211878 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:56.212667 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:56.213110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:56.276150 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:56.283998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-207b919c-3649-424d-9be8-1d15137b2139 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1237 microversion: 2.1 time: 0.084729 May 26 21:34:56.284579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 462/880] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:56 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:56.297274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:56.298188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:56.304865 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:56.305320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:56.306099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:56.306543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:56.442988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:56.450724 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9f934af7-dcec-4493-b555-95d82186d641 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1275 microversion: 2.1 time: 0.157338 May 26 21:34:56.451976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 419/881] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:56 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:56.980385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:56.980910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:56.987588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:56.988159 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:56.988831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:56.989264 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:57.118213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:57.126076 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:57.127586 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:57.128707 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ffde4f63-dcd8-4673-a473-236a382d0fec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.152332 May 26 21:34:57.129265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 463/882] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:56 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:57.304696 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:57.305217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:57.311805 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:57.312265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:57.313030 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:57.313471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:57.379193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:57.386578 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e31fd520-1a48-4cd9-989a-f65962ff91e0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1237 microversion: 2.1 time: 0.085871 May 26 21:34:57.387134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 420/883] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:57 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:57.468893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:57.469502 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:57.476060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:57.476510 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:57.477276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:57.477717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:57.612780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:57.623099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-107d59ca-8afb-4fa2-9f66-01ee4d26f9b7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1275 microversion: 2.1 time: 0.158542 May 26 21:34:57.624961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 464/884] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:57 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:58.146661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:58.147270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:58.159440 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.159926 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.160714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.161154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.361447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:58.370550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:58.372545 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:58.373872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-90c6de84-6edd-43e3-b8c3-9f1966d9077d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.231372 May 26 21:34:58.375067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 421/885] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:58 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:58.405093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:58.412283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:58.412283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.412706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.413505 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.413947 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.489261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:58.498387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c3d5b421-4692-4823-a0e6-a2db9154e50b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1301 microversion: 2.1 time: 0.097857 May 26 21:34:58.499436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 465/886] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:58 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:58.556106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:58.648122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:58.649185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:58.656332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.656791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.657622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.658285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.677765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-94c0ec30-de37-40fc-9b7b-5818d25d8ec3 req-46252334-b7c4-4c8d-b87e-ec1e43f0b1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972688e1-313a-4ed5-8a32-87deda4e5198", "tag": "79857899-1ec0-48de-8faf-2f5625a3ec41"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:34:58.695421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-94c0ec30-de37-40fc-9b7b-5818d25d8ec3 req-46252334-b7c4-4c8d-b87e-ec1e43f0b1b2 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:58.696220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-94c0ec30-de37-40fc-9b7b-5818d25d8ec3 req-46252334-b7c4-4c8d-b87e-ec1e43f0b1b2 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:58.720268 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-94c0ec30-de37-40fc-9b7b-5818d25d8ec3 req-46252334-b7c4-4c8d-b87e-ec1e43f0b1b2 service nova] Creating event network-changed:79857899-1ec0-48de-8faf-2f5625a3ec41 for instance 972688e1-313a-4ed5-8a32-87deda4e5198 on hv-cinder-82880 May 26 21:34:58.727814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-94c0ec30-de37-40fc-9b7b-5818d25d8ec3 req-46252334-b7c4-4c8d-b87e-ec1e43f0b1b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176340 May 26 21:34:58.731050 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 422/887] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:34:58.899946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:58.908915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4e4168ab-2eed-4b0e-bf1d-5df8695e1f43 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1275 microversion: 2.1 time: 0.272914 May 26 21:34:58.916895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 466/888] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:58 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:59.393055 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:59.393786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:59.400164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:59.400613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:59.401376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:59.401808 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:59.518110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:59.518845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:59.525986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:59.526454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:59.527335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:59.527662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:59.543573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:59.549945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:59.553514 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:59.556919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ffa346f9-b5df-4f9e-a0e2-4abc2186df95 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.167115 May 26 21:34:59.558164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 423/889] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:34:59 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:59.734657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:59.742602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-732c41e4-af88-44f4-8984-25a03bf164f3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.230626 May 26 21:34:59.752620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 467/890] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:59 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:34:59.927151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:59.927863 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:59.934497 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:59.934953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:59.936529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:59.936979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:00.067963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:00.075289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b58aeff7-5c0c-4706-8216-54382baa44ca tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.153564 May 26 21:35:00.076517 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 424/891] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:34:59 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:00.574802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:00.575534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:00.583364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:00.584183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:00.585277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:00.585970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:00.590718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:00.762839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:00.764271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:00.775538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:00.776278 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:00.777269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:00.777858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:00.804667 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:00.812072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:00.822355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:00.825581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:00.827461 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-421f86c9-e80d-4147-8c82-471d22119260 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.256944 May 26 21:35:00.828557 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 468/892] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:00 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:35:01.037854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:01.049770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-10ac2bd3-3210-42a0-b579-c89f87f25978 req-5d5187df-6e33-4ca1-935f-cf52dc3158d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31344c9e-84b8-4fc4-9804-30732b08d70e", "tag": "74b8602f-769d-4945-bc28-0333c237b868"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:01.059700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-177d4ed3-889e-4c72-b5c2-b7b29fb5da92 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.301500 May 26 21:35:01.061866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 425/893] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:00 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:01.063480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-10ac2bd3-3210-42a0-b579-c89f87f25978 req-5d5187df-6e33-4ca1-935f-cf52dc3158d1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:01.064208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-10ac2bd3-3210-42a0-b579-c89f87f25978 req-5d5187df-6e33-4ca1-935f-cf52dc3158d1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:01.086183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-10ac2bd3-3210-42a0-b579-c89f87f25978 req-5d5187df-6e33-4ca1-935f-cf52dc3158d1 service nova] Creating event network-changed:74b8602f-769d-4945-bc28-0333c237b868 for instance 31344c9e-84b8-4fc4-9804-30732b08d70e on hv-cinder-82880 May 26 21:35:01.091556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-10ac2bd3-3210-42a0-b579-c89f87f25978 req-5d5187df-6e33-4ca1-935f-cf52dc3158d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049777 May 26 21:35:01.092418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 469/894] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:35:01.097542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:01.098326 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:01.108570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:01.109301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:01.110542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:01.111147 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:01.338138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:01.347905 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bc6aa517-5a75-4497-9d49-19e2d50702ce tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.258100 May 26 21:35:01.348743 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 426/895] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:01 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:01.780481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-7dd68684-7a7d-4a3d-89d9-60a5f3c02e42 req-8e8b22d7-5b54-4e30-8589-5ccd6577c688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "name": "network-vif-plugged", "status": "completed", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:01.789418 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-7dd68684-7a7d-4a3d-89d9-60a5f3c02e42 req-8e8b22d7-5b54-4e30-8589-5ccd6577c688 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:01.789997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-7dd68684-7a7d-4a3d-89d9-60a5f3c02e42 req-8e8b22d7-5b54-4e30-8589-5ccd6577c688 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:01.804596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-7dd68684-7a7d-4a3d-89d9-60a5f3c02e42 req-8e8b22d7-5b54-4e30-8589-5ccd6577c688 service nova] Creating event network-vif-plugged:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:35:01.809556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-7dd68684-7a7d-4a3d-89d9-60a5f3c02e42 req-8e8b22d7-5b54-4e30-8589-5ccd6577c688 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 May 26 21:35:01.810156 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 470/896] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:01.845847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:01.846456 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:01.852975 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:01.853425 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:01.854196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:01.854635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:02.069101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:02.080635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:02.081465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:02.085549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:02.087356 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:02.087717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:02.088209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:02.088504 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fc876cdf-1bd5-46b6-a66c-76fbc4dbf904 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.247201 May 26 21:35:02.089229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:02.089715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 427/897] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:01 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:35:02.090175 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:02.227932 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:02.236564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-69168805-ef18-467e-8eca-dfdc0652b0ca tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.161972 May 26 21:35:02.237132 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 471/898] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:02 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:02.364862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:02.365478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:02.371575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:02.372032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:02.373307 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:02.373741 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:02.508777 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:02.517102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-496668cb-7daf-42b0-9097-05d74a3a0df3 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.156075 May 26 21:35:02.517673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 428/899] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:02 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:03.108148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:03.108765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:03.115324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:03.115878 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:03.116661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:03.117110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:03.243470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:03.252459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:03.253298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:03.253909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:03.254015 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:03.255074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e8551c30-39c3-40c8-bdad-db811b5f61ee tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.151565 May 26 21:35:03.255630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 472/900] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:03 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:35:03.260833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:03.261323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:03.262093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:03.262532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:03.391854 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:03.400872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d0aec858-973a-4c7a-964a-ad5be693cb51 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.151337 May 26 21:35:03.401443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 429/901] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:03 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:03.534011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:03.534627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:03.540987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:03.541443 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:03.542793 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:03.543238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:03.683376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:03.692501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a1a826bf-d65a-4123-8749-2919f7bd5ca0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.162974 May 26 21:35:03.693078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 473/902] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:03 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:04.274438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:04.275052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:04.276909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=20 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:04.282526 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:04.282973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:04.283794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:04.284332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:04.410958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:04.418014 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:04.418621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:04.419140 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:04.421202 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:04.421376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:04.421866 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=12 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:04.422734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6c5bca23-8578-4e48-a83d-6e55802ee4e2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.152044 May 26 21:35:04.423303 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 430/903] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:04 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:35:04.427648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:04.428143 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:04.434924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:04.434924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:04.571275 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:04.575557 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3a710458-2acf-4682-b2bc-efc23e923d8d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.161329 May 26 21:35:04.576204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 474/904] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:04 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:04.710162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:04.710776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:04.717345 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:04.717792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:04.718551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:04.718985 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:04.848067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:04.855488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-40dbd8cc-cd80-4cb6-a882-842406a7f045 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.149209 May 26 21:35:04.856142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 431/905] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:04 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:05.440933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:05.441544 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:05.448093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:05.448543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:05.449308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:05.449746 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:05.575491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:05.583630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:05.585241 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:05.586365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cb266a03-0773-4d51-b372-47ce5d5d218c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.149362 May 26 21:35:05.593084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:05.593959 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:05.597000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 475/906] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:05 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:35:05.600901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:05.601449 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:05.602292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:05.602794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:05.739235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:05.746776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-41d48ca6-bf5a-4aeb-8658-7445c26062cc tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.157734 May 26 21:35:05.748306 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 432/907] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:05 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:05.873364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:05.873989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:05.880215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:05.880669 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:05.881454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:05.881891 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:06.012478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:06.019967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e28f8908-5950-41d5-a241-44e84d0b3c3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.151062 May 26 21:35:06.020532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 476/908] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:05 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:06.604548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:06.605130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:06.611598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:06.612118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:06.612853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:06.613287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:06.740671 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:06.749142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:06.750661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:06.751772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9be06ced-d8e9-4256-ab52-cdde1439a11d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1407 microversion: 2.20 time: 0.151242 May 26 21:35:06.752340 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 433/909] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:06 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:35:06.765279 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:06.765984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:06.772580 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:06.773028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:06.775112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:06.775112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:06.902805 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:06.910336 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1f99e41b-06db-4e4f-a69c-c5c73c37cd56 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.149997 May 26 21:35:06.910902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 477/910] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:06 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:07.037104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:07.037715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:07.043829 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.044281 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.045048 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.045486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.173634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:07.181855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c136eeb4-0425-4e90-ae86-20906a88696a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.148518 May 26 21:35:07.182661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 434/911] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:07 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:07.770006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:07.770635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:07.777332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.777800 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.778548 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.778982 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.819484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-4989c7fd-b601-45db-84c1-23e5b928d5c0 req-952c1384-7756-48d8-8b14-7be17670647f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31344c9e-84b8-4fc4-9804-30732b08d70e", "name": "network-vif-plugged", "status": "completed", "tag": "74b8602f-769d-4945-bc28-0333c237b868"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:07.832160 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-4989c7fd-b601-45db-84c1-23e5b928d5c0 req-952c1384-7756-48d8-8b14-7be17670647f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.832160 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-4989c7fd-b601-45db-84c1-23e5b928d5c0 req-952c1384-7756-48d8-8b14-7be17670647f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.843765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-4989c7fd-b601-45db-84c1-23e5b928d5c0 req-952c1384-7756-48d8-8b14-7be17670647f service nova] Creating event network-vif-plugged:74b8602f-769d-4945-bc28-0333c237b868 for instance 31344c9e-84b8-4fc4-9804-30732b08d70e on hv-cinder-82880 May 26 21:35:07.848915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-4989c7fd-b601-45db-84c1-23e5b928d5c0 req-952c1384-7756-48d8-8b14-7be17670647f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036421 May 26 21:35:07.849436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 435/912] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:35:07.929562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:07.930602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:07.933366 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:07.938565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.939245 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.940096 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.940567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.942075 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:07.943623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:07.944977 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-99e587b2-08c4-46aa-8aa8-7f08b0f3ab3e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1599 microversion: 2.20 time: 0.178973 May 26 21:35:07.945709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 478/913] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:35:07 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:35:07.962867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:07.966873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:07.970619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.971156 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:07.972081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:07.972604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:08.055134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-efa4cb80-633c-4d38-b6d2-ce3f3bcf9e4a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096067 May 26 21:35:08.055843 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 479/914] 10.222.0.42 () {60 vars in 1315 bytes} [Thu May 26 21:35:07 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:35:08.084182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:08.091807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-de2bcada-ecf6-4c23-a844-f544d2734229 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.166553 May 26 21:35:08.097244 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 436/915] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:07 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:08.198601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:08.199211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:08.205483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:08.206078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:08.206933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:08.207364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:08.462142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:08.470452 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2554b97f-8e06-4002-b86b-b6775f6dbf09 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.275795 May 26 21:35:08.471029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 480/916] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:08 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:09.097591 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-a830ace6-a935-4613-9ff3-937ca339e3af req-2f012aaa-3f15-4f0f-8e02-115c0e0a309e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:09.106224 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-a830ace6-a935-4613-9ff3-937ca339e3af req-2f012aaa-3f15-4f0f-8e02-115c0e0a309e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:09.106672 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-a830ace6-a935-4613-9ff3-937ca339e3af req-2f012aaa-3f15-4f0f-8e02-115c0e0a309e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:09.111927 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:09.112547 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:09.118888 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-a830ace6-a935-4613-9ff3-937ca339e3af req-2f012aaa-3f15-4f0f-8e02-115c0e0a309e service nova] Creating event network-changed:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:35:09.119478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:09.120186 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:09.120959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:09.121395 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:09.124337 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-a830ace6-a935-4613-9ff3-937ca339e3af req-2f012aaa-3f15-4f0f-8e02-115c0e0a309e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030344 May 26 21:35:09.125264 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 437/917] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:09.257642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:09.266149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4ad59ffc-9a01-4c7b-b46b-071dfce4ebea tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.158615 May 26 21:35:09.266732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 481/918] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:09 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:09.487519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:09.488288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:09.494910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:09.495362 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:09.496167 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:09.496603 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:09.694844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:09.712604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ddd17780-59b8-447a-9875-bb0f24eeecb5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.229348 May 26 21:35:09.713189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 438/919] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:09 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:10.284521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:10.285698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:10.293127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:10.293573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:10.294359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:10.294853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:10.454673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:10.462962 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ccebc0dc-2fb6-4d29-8a3b-50c3732dd72a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1365 microversion: 2.1 time: 0.184422 May 26 21:35:10.464752 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 482/920] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:10 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:10.729448 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:10.730060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:10.737339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:10.737799 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:10.738564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:10.739031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:10.867493 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:10.875136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b3750605-b772-4c2d-9b14-e05d71ef5f45 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.149614 May 26 21:35:10.875704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 439/921] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:10 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:11.481103 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:11.481715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:11.488768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.489223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.489987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.490425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.618704 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:11.626882 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f8cc6663-2b16-4d85-b0b4-9bad6c53205f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1554 microversion: 2.1 time: 0.149723 May 26 21:35:11.627445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 483/922] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:11 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:11.643792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:11.644284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:11.650554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.651001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.651804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.652246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.730284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-185ca5db-8077-4eff-9466-df361a5b39c9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091116 May 26 21:35:11.730876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 440/923] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:35:11 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:11.892641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:11.893446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:11.899796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.900879 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.901205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.901714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.924553 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-cd32428c-8a47-464c-a066-ff15a3b6a8bb req-2d2d13a8-16e5-4506-a45c-e4fd6208a336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972688e1-313a-4ed5-8a32-87deda4e5198", "name": "network-vif-plugged", "status": "completed", "tag": "79857899-1ec0-48de-8faf-2f5625a3ec41"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:11.934945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-cd32428c-8a47-464c-a066-ff15a3b6a8bb req-2d2d13a8-16e5-4506-a45c-e4fd6208a336 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:11.935397 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-cd32428c-8a47-464c-a066-ff15a3b6a8bb req-2d2d13a8-16e5-4506-a45c-e4fd6208a336 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:11.948722 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-cd32428c-8a47-464c-a066-ff15a3b6a8bb req-2d2d13a8-16e5-4506-a45c-e4fd6208a336 service nova] Creating event network-vif-plugged:79857899-1ec0-48de-8faf-2f5625a3ec41 for instance 972688e1-313a-4ed5-8a32-87deda4e5198 on hv-cinder-82880 May 26 21:35:11.954441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-cd32428c-8a47-464c-a066-ff15a3b6a8bb req-2d2d13a8-16e5-4506-a45c-e4fd6208a336 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034351 May 26 21:35:11.955056 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 441/924] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:35:12.076107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:12.084301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0f8791ad-9542-4a41-8680-12ac71cdc62f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.196407 May 26 21:35:12.085881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 484/925] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:11 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:13.063940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-be146cca-4149-4b8c-b24e-9af225be17ba req-a02ca26f-965b-4f96-b31a-eb18f279cd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31344c9e-84b8-4fc4-9804-30732b08d70e", "tag": "74b8602f-769d-4945-bc28-0333c237b868"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:13.072276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-be146cca-4149-4b8c-b24e-9af225be17ba req-a02ca26f-965b-4f96-b31a-eb18f279cd5c service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:13.072809 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-be146cca-4149-4b8c-b24e-9af225be17ba req-a02ca26f-965b-4f96-b31a-eb18f279cd5c service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:13.085164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-be146cca-4149-4b8c-b24e-9af225be17ba req-a02ca26f-965b-4f96-b31a-eb18f279cd5c service nova] Creating event network-changed:74b8602f-769d-4945-bc28-0333c237b868 for instance 31344c9e-84b8-4fc4-9804-30732b08d70e on hv-cinder-82880 May 26 21:35:13.090160 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-be146cca-4149-4b8c-b24e-9af225be17ba req-a02ca26f-965b-4f96-b31a-eb18f279cd5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030718 May 26 21:35:13.090767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 442/926] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:13.102106 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:13.102934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:13.109640 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:13.110159 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:13.111002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:13.111521 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:13.259508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:13.267804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5ade619e-04da-44ee-a6a7-3a8a9e9168b2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.169473 May 26 21:35:13.268464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 485/927] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:13 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:14.285620 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:14.286311 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:14.292510 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:14.292955 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:14.293826 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:14.294294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:14.481646 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:14.489831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f0729be6-ec0f-4765-9808-35b41e8594c7 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1263 microversion: 2.1 time: 0.209048 May 26 21:35:14.490415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 443/928] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:14 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:15.506773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:15.507364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:15.514191 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:15.515783 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:15.516401 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:15.516836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:15.536311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:15.649642 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:15.658072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7d8f40b4-2e9c-46fa-8a2b-b2d5d7ea5e86 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1451 microversion: 2.1 time: 0.155273 May 26 21:35:15.658644 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 486/929] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:15 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:15.674757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:15.675376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:15.681947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:15.682406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:15.683184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:15.683630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:15.817401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:15.824913 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-076370a0-b7c1-4602-9714-b75420589606 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1451 microversion: 2.1 time: 0.154829 May 26 21:35:15.825470 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 444/930] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:15 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:17.920098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-a9ac1936-ea45-4470-b71e-ef5e82853698 req-01551fec-8fa7-4ace-91b1-85fd70f1b72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972688e1-313a-4ed5-8a32-87deda4e5198", "tag": "79857899-1ec0-48de-8faf-2f5625a3ec41"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:17.929453 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-a9ac1936-ea45-4470-b71e-ef5e82853698 req-01551fec-8fa7-4ace-91b1-85fd70f1b72e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:17.939473 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-a9ac1936-ea45-4470-b71e-ef5e82853698 req-01551fec-8fa7-4ace-91b1-85fd70f1b72e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:17.941098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-a9ac1936-ea45-4470-b71e-ef5e82853698 req-01551fec-8fa7-4ace-91b1-85fd70f1b72e service nova] Creating event network-changed:79857899-1ec0-48de-8faf-2f5625a3ec41 for instance 972688e1-313a-4ed5-8a32-87deda4e5198 on hv-cinder-82880 May 26 21:35:17.946434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-a9ac1936-ea45-4470-b71e-ef5e82853698 req-01551fec-8fa7-4ace-91b1-85fd70f1b72e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030162 May 26 21:35:17.947026 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 487/931] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:18.943276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:18.943923 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:18.950151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:18.955116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:18.955116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:18.955116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:18.956433 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:19.042329 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'services' on Instance uuid 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:19.339792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-33b3ed3f-f875-49a4-a219-d57dba09616b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments/c433cffb-d5ad-4e4c-b652-407a846b8be6" status: 202 len: 0 microversion: 2.1 time: 0.400443 May 26 21:35:19.340407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 445/932] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:35:18 2022] DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments/c433cffb-d5ad-4e4c-b652-407a846b8be6 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:35:19.350504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:19.351541 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:19.358685 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:19.359140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:19.359946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:19.360392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:19.390556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f81b45dc-9a96-48d3-b4db-e16ba01e0eb8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 May 26 21:35:19.391118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 488/933] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:35:19 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:20.403836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:20.405347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:20.412269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:20.418442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:20.418442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:20.418442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:20.446302 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-69465e40-1f74-4bf5-a27a-422409052996 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 May 26 21:35:20.446972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 446/934] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:35:20 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:21.457591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:21.458519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:21.465098 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:21.465551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:21.466315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:21.466752 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:21.495318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3034f79a-4682-45f3-94de-68f0f0d22a4f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041666 May 26 21:35:21.495907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 489/935] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:35:21 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:35:21.568127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:21.571330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:21.571330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:21.575412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:21.575908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:21.576699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:21.577146 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:21.602379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:35:21.906952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-60c62ff9-8d00-445d-a5a5-a6ef039472ee tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 204 len: 0 microversion: 2.1 time: 0.342943 May 26 21:35:21.907668 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 447/936] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:35:21 2022] DELETE /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:35:21.917223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:21.917838 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:21.924800 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:21.925252 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:21.926022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:21.926536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:22.060099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:22.067662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-08b714ae-1fea-4285-864f-a9db12b04006 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1690 microversion: 2.1 time: 0.154336 May 26 21:35:22.068262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 490/937] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:21 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:23.085745 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:23.086354 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:23.092908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:23.093349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:23.094110 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:23.094542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:23.226828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:23.235144 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-184ceae2-9977-41a2-879b-c892389866d0 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1690 microversion: 2.1 time: 0.153732 May 26 21:35:23.235703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 448/938] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:23 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:24.253619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:24.254227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:24.260721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:24.261167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:24.261925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:24.262359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:24.387828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:24.395404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5fd01311-6c26-41e4-936d-f1f1e16a37b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1690 microversion: 2.1 time: 0.146438 May 26 21:35:24.396004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 491/939] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:24 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:25.412471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:25.413065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:25.419579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:25.420056 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:25.420857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:25.421294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:25.662997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:25.671057 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-89e506ea-8dd4-4e99-bb7c-09e1ce96fe1c tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1690 microversion: 2.1 time: 0.261926 May 26 21:35:25.671635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 449/940] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:25 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:26.086837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-34a300c8-fd04-46ed-a05b-de09ef4fe6cb req-86d17c9e-2e66-447f-ab9f-08a5f5ea581a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc04f2a-62bb-407b-b8d1-0e69eac279c2", "name": "network-vif-deleted", "tag": "7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:26.092849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=67 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:26.096996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-34a300c8-fd04-46ed-a05b-de09ef4fe6cb req-86d17c9e-2e66-447f-ab9f-08a5f5ea581a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:26.097511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-34a300c8-fd04-46ed-a05b-de09ef4fe6cb req-86d17c9e-2e66-447f-ab9f-08a5f5ea581a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:26.108968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-34a300c8-fd04-46ed-a05b-de09ef4fe6cb req-86d17c9e-2e66-447f-ab9f-08a5f5ea581a service nova] Creating event network-vif-deleted:7ac14258-ea6a-4ad5-9917-4ed15bf4d8e9 for instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 on hv-cinder-82880 May 26 21:35:26.114100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-34a300c8-fd04-46ed-a05b-de09ef4fe6cb req-86d17c9e-2e66-447f-ab9f-08a5f5ea581a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 May 26 21:35:26.114803 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 492/941] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:26.688887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:26.689505 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:26.696130 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:26.698400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:26.698400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:26.698400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:26.735189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:26.735650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:26.736144 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'fault' on Instance uuid 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:26.782227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:26.789818 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1f2cb458-4fc6-4de9-ba92-48e303f77e9b tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 200 len: 1335 microversion: 2.1 time: 0.105933 May 26 21:35:26.790383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 450/942] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:26 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:26.921717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1439677229"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:26.926959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:26.929188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:26.929649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:26.930445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:26.930901 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:27.068095 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.network.security_group_api [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Removing security group 7edb3ef7-e7c8-45f8-8c05-f77bb963aaaa from port c738b38d-cc3a-42ab-8d0f-8c9dc892211c May 26 21:35:27.737717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4a1dc918-f0eb-4b37-b45c-417f339610a6 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/action" status: 202 len: 0 microversion: 2.1 time: 0.934802 May 26 21:35:27.741888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 493/943] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:35:26 2022] POST /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/action => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:35:27.745923 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-e5d88d4f-3ab6-4d68-8e52-7245c7072b1c req-cb14fc8e-9d24-47be-b16e-a5fc67394296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:27.757561 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-e5d88d4f-3ab6-4d68-8e52-7245c7072b1c req-cb14fc8e-9d24-47be-b16e-a5fc67394296 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:27.758011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-e5d88d4f-3ab6-4d68-8e52-7245c7072b1c req-cb14fc8e-9d24-47be-b16e-a5fc67394296 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:27.770690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-e5d88d4f-3ab6-4d68-8e52-7245c7072b1c req-cb14fc8e-9d24-47be-b16e-a5fc67394296 service nova] Creating event network-changed:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:35:27.776627 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-e5d88d4f-3ab6-4d68-8e52-7245c7072b1c req-cb14fc8e-9d24-47be-b16e-a5fc67394296 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034337 May 26 21:35:27.778988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 451/944] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:35:27.808022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:27.808631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 8cc04f2a-62bb-407b-b8d1-0e69eac279c2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:27.816073 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:27.816403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:27.817267 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:27.817714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:27.836118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] HTTP exception thrown: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 could not be found. May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Request method failure captured: May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 HTTP/1.1 May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_C0GQ-INvXduMwRGm3c4_grfgBDzDAf36288IjzTjUlGN5KOZEPTFz1tsu5su5_qXahLBmX-nMCklW5U-v5JAVsuvZ9bMUL1HpZ0TlBEfT1Z3537_WDj0yIeFhry6wX2_uaUprVJOTtyS2h_zAdtBoy5cowHpeB5CvHyF_ShVtbKrc May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 318999cb1f874176b2523de9686febc1 May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:35:27.837821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_318999cb1f874176b2523de9686febc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/318999cb1f874176b2523de9686febc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}] May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 318999cb1f874176b2523de9686febc1 May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: ee4307a7bdf84fe18efd6ba3dbe50c23 May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 could not be found. May 26 21:35:27.839532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '8cc04f2a-62bb-407b-b8d1-0e69eac279c2'} May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 could not be found. May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:27.840535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 could not be found. May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 could not be found. May 26 21:35:27.842052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:27.843457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Returning 404 to user: Instance 8cc04f2a-62bb-407b-b8d1-0e69eac279c2 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:27.843457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4c867fe2-c9f7-4b0e-90ab-a857421b62de tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2" status: 404 len: 111 microversion: 2.1 time: 0.035744 May 26 21:35:27.843457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 494/945] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:27 2022] GET /compute/v2.1/servers/8cc04f2a-62bb-407b-b8d1-0e69eac279c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:35:27.848883 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ef1a8985-b7f3-4648-8a56-c1a883595635 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '.version_select at 0x7f7bc4c99ee0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:27.959046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ef1a8985-b7f3-4648-8a56-c1a883595635 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051828551" status: 202 len: 0 microversion: 2.1 time: 0.114304 May 26 21:35:27.959947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 452/946] 10.222.0.42 () {58 vars in 1220 bytes} [Thu May 26 21:35:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051828551 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:35:29.440568 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:29.441117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:29.447818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:29.448281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:29.449062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:29.449504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:29.536187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lazy-loading 'services' on Instance uuid 6f6d3384-3b9f-4042-a947-d15b99941c35 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:29.792175 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-0203de6d-b80c-4b0a-8902-eab814ad059d req-e7f1f6b1-6b33-40ad-a8e8-38b58dcabc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:29.801259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-0203de6d-b80c-4b0a-8902-eab814ad059d req-e7f1f6b1-6b33-40ad-a8e8-38b58dcabc99 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:29.801784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-0203de6d-b80c-4b0a-8902-eab814ad059d req-e7f1f6b1-6b33-40ad-a8e8-38b58dcabc99 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:29.804461 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3117049a-2f52-4103-9fdc-6ee5b07f2b8c tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments/0192dd33-e41b-40b2-932f-eb013b5395c9" status: 202 len: 0 microversion: 2.1 time: 0.367146 May 26 21:35:29.805132 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 495/947] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:35:29 2022] DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments/0192dd33-e41b-40b2-932f-eb013b5395c9 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:35:29.813577 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-0203de6d-b80c-4b0a-8902-eab814ad059d req-e7f1f6b1-6b33-40ad-a8e8-38b58dcabc99 service nova] Creating event network-changed:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:35:29.814020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:29.818734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-0203de6d-b80c-4b0a-8902-eab814ad059d req-e7f1f6b1-6b33-40ad-a8e8-38b58dcabc99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030740 May 26 21:35:29.819531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 453/948] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:35:29.831590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:29.840402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:29.841204 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:29.841997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:29.843603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:29.877589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-126d41e0-02e1-40d1-b70e-4aaa63c318c0 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067600 May 26 21:35:29.878191 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 496/949] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:35:29 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:30.891268 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:30.892302 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:30.898623 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:30.899053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:30.899855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:30.900298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:30.932126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-745f0177-7feb-45e9-ae0f-65c30ce866e1 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045870 May 26 21:35:30.936195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 454/950] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:35:30 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:31.631733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:31.632247 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:31.638734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.639846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:31.640619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.641058 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:31.666391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:35:31.943157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:31.944171 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:31.950757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.951207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:31.952178 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.952432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:31.980357 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5e9babaf-fe40-402f-9544-f1987e35aad9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041091 May 26 21:35:31.985766 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-486fe80e-fcf9-454d-b9c1-072d8fd041fe tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 204 len: 0 microversion: 2.1 time: 0.352690 May 26 21:35:31.985923 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 455/951] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:35:31 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 21:35:31.986032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 497/952] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:35:31 2022] DELETE /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 21:35:31.990436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:31.991044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:31.991470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:31.992080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:31.997211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.997665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:31.998433 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.999159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:31.999358 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:31.999592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:32.000082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:32.000522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:32.083038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] HTTP exception thrown: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 is not attached to volume 0192dd33-e41b-40b2-932f-eb013b5395c9 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Request method failure captured: May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments/0192dd33-e41b-40b2-932f-eb013b5395c9 HTTP/1.1 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_FVYNg03hMQXjPtaXXJZAk-452Q2GnoeQXZKl8xmo_7Au9Aeh7xGqJKrQSSawQoBUaENxNtqA0QyxYjKYlzRqvPngy05vv2qrgp6yeBmayUw3lvZf1_w24T16DKjhYTmscxvzzCM6zNOOaH9ICXtrH7_2uh1ctVY8pySP_AMTXLQiI May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 771d85ed5c3b4a6bbc9945d88cfcbab8 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-TestMinimumBasicScenario-1608082827 May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:35:32.091678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_771d85ed5c3b4a6bbc9945d88cfcbab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/771d85ed5c3b4a6bbc9945d88cfcbab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771d85ed5c3b4a6bbc9945d88cfcbab8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771d85ed5c3b4a6bbc9945d88cfcbab8"}]}] May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-TestMinimumBasicScenario-1608082827 May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 771d85ed5c3b4a6bbc9945d88cfcbab8 May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1608082827 May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-TestMinimumBasicScenario-1608082827-project May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: b9537b7add3b4b5da501903db49a2a11 May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-TestMinimumBasicScenario-1608082827-project May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:35:32.093153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 is not attached to volume 0192dd33-e41b-40b2-932f-eb013b5395c9 May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'server_id': '6f6d3384-3b9f-4042-a947-d15b99941c35', 'id': '0192dd33-e41b-40b2-932f-eb013b5395c9'} May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0192dd33-e41b-40b2-932f-eb013b5395c9. May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:32.093943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 is not attached to volume 0192dd33-e41b-40b2-932f-eb013b5395c9 May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 is not attached to volume 0192dd33-e41b-40b2-932f-eb013b5395c9 May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:32.095525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Returning 404 to user: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 is not attached to volume 0192dd33-e41b-40b2-932f-eb013b5395c9 {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:32.097010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5ef4e3dc-2772-423e-b931-773fe41af07f tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments/0192dd33-e41b-40b2-932f-eb013b5395c9" status: 404 len: 154 microversion: 2.1 time: 0.106137 May 26 21:35:32.097010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 498/953] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:35:31 2022] DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35/os-volume_attachments/0192dd33-e41b-40b2-932f-eb013b5395c9 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:35:32.132221 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:32.139621 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f6665bcd-4fb6-4c67-a866-ed03e5130fe6 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1504 microversion: 2.1 time: 0.152927 May 26 21:35:32.146143 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 456/954] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:31 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:33.161372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:33.161986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:33.168550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.169005 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.169784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.170226 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.237756 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:33.245781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1f3de68b-fd04-4d5f-bef7-ae0dc3aa59b8 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1462 microversion: 2.1 time: 0.088068 May 26 21:35:33.246300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 499/955] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:33 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:33.294352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-f287e887-10e1-4501-be53-95797261d966 req-52349e77-6e88-47b6-aa2f-54a94bda2a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1", "name": "network-vif-deleted", "tag": "24cfeb63-c26b-4bcf-af3c-b3af9fdb259d"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:33.303999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f287e887-10e1-4501-be53-95797261d966 req-52349e77-6e88-47b6-aa2f-54a94bda2a61 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.304454 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f287e887-10e1-4501-be53-95797261d966 req-52349e77-6e88-47b6-aa2f-54a94bda2a61 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.316796 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-f287e887-10e1-4501-be53-95797261d966 req-52349e77-6e88-47b6-aa2f-54a94bda2a61 service nova] Creating event network-vif-deleted:24cfeb63-c26b-4bcf-af3c-b3af9fdb259d for instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 on hv-cinder-82880 May 26 21:35:33.322010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-f287e887-10e1-4501-be53-95797261d966 req-52349e77-6e88-47b6-aa2f-54a94bda2a61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 May 26 21:35:33.322620 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 457/956] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:33.377354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:33.377900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:33.384065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.384519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.385296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.385957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.411640 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:35:33.678069 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8817460a-08ac-49aa-a7ce-6000cde0e51b tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 204 len: 0 microversion: 2.1 time: 0.304430 May 26 21:35:33.678845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 500/957] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:35:33 2022] DELETE /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:35:33.687583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:33.688410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:33.694950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.695640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.696564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:33.697001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:33.829322 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:33.836831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8cef9c00-c483-4bf2-9086-1b6ac24a8c06 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1553 microversion: 2.1 time: 0.153527 May 26 21:35:33.837406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 458/958] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:33 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:34.264633 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:34.265355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:34.271969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:34.272423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:34.273195 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:34.273633 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:34.292130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:34.305177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:34.305631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:34.306082 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'fault' on Instance uuid d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:34.346570 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:34.353895 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-57a02e87-4b8f-4103-a0f5-e20297520383 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1309 microversion: 2.1 time: 0.094149 May 26 21:35:34.354463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 501/959] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:34 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:34.854616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:34.855231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:34.862300 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:34.862760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:34.863523 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:34.863987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:34.993893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:35.002004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-39cc968f-0d81-48cf-ba12-30cf1f97c633 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1553 microversion: 2.1 time: 0.151327 May 26 21:35:35.002568 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 459/960] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:34 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:35.371003 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:35.371556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:35.378400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:35.378849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:35.379612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:35.380072 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:35.411206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:35.411656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:35.412137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'fault' on Instance uuid d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:35.454885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:35.462584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2e190286-90f1-4f49-85e5-6add3eb632e9 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 200 len: 1309 microversion: 2.1 time: 0.095929 May 26 21:35:35.463155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 502/961] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:35 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:36.019698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:36.020353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:36.027122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.027575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.028387 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.028846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.196113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:36.204402 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9af9d48c-0540-4e61-9910-ee6c8ddaaae9 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1553 microversion: 2.1 time: 0.188839 May 26 21:35:36.204936 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 460/962] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:36 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:36.478930 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:36.479549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:36.486906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.487393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.488206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.488660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.503085 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] HTTP exception thrown: Instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 could not be found. May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Request method failure captured: May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 HTTP/1.1 May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_C0GQ-INvXduMwRGm3c4_grfgBDzDAf36288IjzTjUlGN5KOZEPTFz1tsu5su5_qXahLBmX-nMCklW5U-v5JAVsuvZ9bMUL1HpZ0TlBEfT1Z3537_WDj0yIeFhry6wX2_uaUprVJOTtyS2h_zAdtBoy5cowHpeB5CvHyF_ShVtbKrc May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 318999cb1f874176b2523de9686febc1 May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:35:36.505780 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_318999cb1f874176b2523de9686febc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/318999cb1f874176b2523de9686febc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}] May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 318999cb1f874176b2523de9686febc1 May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: ee4307a7bdf84fe18efd6ba3dbe50c23 May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 could not be found. May 26 21:35:36.507556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': 'd05b42bf-dc0a-43d4-a6e9-d5126fffc9e1'} May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 could not be found. May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:36.508641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 could not be found. May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 could not be found. May 26 21:35:36.510138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:36.512117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Returning 404 to user: Instance d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:36.512117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-207281cd-bfc1-4078-b195-91c4d8d81940 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1" status: 404 len: 111 microversion: 2.1 time: 0.032325 May 26 21:35:36.512117 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 503/963] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:36 2022] GET /compute/v2.1/servers/d05b42bf-dc0a-43d4-a6e9-d5126fffc9e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:35:36.516093 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:36.522898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:36.523260 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.523715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.524551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.524996 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.553771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:35:36.565821 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:36.701408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-2e22c35b-ae72-4e9d-990e-b6876a6d5e0a req-1d14e8c3-e1c3-4dff-9951-61d99d92e558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6d3384-3b9f-4042-a947-d15b99941c35", "name": "network-vif-deleted", "tag": "c738b38d-cc3a-42ab-8d0f-8c9dc892211c"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:36.710067 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-2e22c35b-ae72-4e9d-990e-b6876a6d5e0a req-1d14e8c3-e1c3-4dff-9951-61d99d92e558 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.710527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-2e22c35b-ae72-4e9d-990e-b6876a6d5e0a req-1d14e8c3-e1c3-4dff-9951-61d99d92e558 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.722468 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-2e22c35b-ae72-4e9d-990e-b6876a6d5e0a req-1d14e8c3-e1c3-4dff-9951-61d99d92e558 service nova] Creating event network-vif-deleted:c738b38d-cc3a-42ab-8d0f-8c9dc892211c for instance 6f6d3384-3b9f-4042-a947-d15b99941c35 on hv-cinder-82880 May 26 21:35:36.727359 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-2e22c35b-ae72-4e9d-990e-b6876a6d5e0a req-1d14e8c3-e1c3-4dff-9951-61d99d92e558 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029584 May 26 21:35:36.728024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 504/964] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:35:36.855008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b763b469-6565-4b79-aaa6-10ba168ab51f tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 204 len: 0 microversion: 2.1 time: 0.342320 May 26 21:35:36.855558 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 461/965] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:35:36 2022] DELETE /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:35:36.865130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:36.865826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:36.872333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.872785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:36.873633 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:36.874111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:37.013710 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:37.022606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-78314485-4896-4b88-823e-880c06b56819 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1520 microversion: 2.1 time: 0.161792 May 26 21:35:37.023182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 505/966] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:36 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:37.222689 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:37.223333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:37.230204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:37.230655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:37.231419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:37.231908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:37.261720 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:37.262185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:37.262633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lazy-loading 'fault' on Instance uuid 6f6d3384-3b9f-4042-a947-d15b99941c35 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:37.304199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9537b7add3b4b5da501903db49a2a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771d85ed5c3b4a6bbc9945d88cfcbab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:37.311640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-927cd6ae-e8ce-4549-aba6-fda2a3517250 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 200 len: 1348 microversion: 2.1 time: 0.093382 May 26 21:35:37.312228 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 462/967] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:37 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:38.040643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:38.041353 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:38.048563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:38.049016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:38.049801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:38.056188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:38.143969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:38.156749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f7ded99c-6ec2-43f1-b964-9706977b9974 tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1478 microversion: 2.1 time: 0.114767 May 26 21:35:38.156749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 506/968] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:38 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1478 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:35:38.328708 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:38.329261 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] [instance: 6f6d3384-3b9f-4042-a947-d15b99941c35] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:38.335910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:38.336358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:38.337120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:38.337587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] HTTP exception thrown: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 could not be found. May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Request method failure captured: May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 HTTP/1.1 May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_FVYNg03hMQXjPtaXXJZAk-452Q2GnoeQXZKl8xmo_7Au9Aeh7xGqJKrQSSawQoBUaENxNtqA0QyxYjKYlzRqvPngy05vv2qrgp6yeBmayUw3lvZf1_w24T16DKjhYTmscxvzzCM6zNOOaH9ICXtrH7_2uh1ctVY8pySP_AMTXLQiI May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 771d85ed5c3b4a6bbc9945d88cfcbab8 May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-TestMinimumBasicScenario-1608082827 May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:35:38.355759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_771d85ed5c3b4a6bbc9945d88cfcbab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/771d85ed5c3b4a6bbc9945d88cfcbab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771d85ed5c3b4a6bbc9945d88cfcbab8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771d85ed5c3b4a6bbc9945d88cfcbab8"}]}] May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-TestMinimumBasicScenario-1608082827 May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 771d85ed5c3b4a6bbc9945d88cfcbab8 May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1608082827 May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-TestMinimumBasicScenario-1608082827-project May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: b9537b7add3b4b5da501903db49a2a11 May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-TestMinimumBasicScenario-1608082827-project May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 could not be found. May 26 21:35:38.357489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '6f6d3384-3b9f-4042-a947-d15b99941c35'} May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 could not be found. May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:38.358909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 could not be found. May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 could not be found. May 26 21:35:38.360429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:38.361864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Returning 404 to user: Instance 6f6d3384-3b9f-4042-a947-d15b99941c35 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:38.361864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d1d11a8f-b499-4ce2-a7e0-55cc07cb85b7 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35" status: 404 len: 111 microversion: 2.1 time: 0.031733 May 26 21:35:38.361864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 463/969] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:38 2022] GET /compute/v2.1/servers/6f6d3384-3b9f-4042-a947-d15b99941c35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:35:38.365589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-be1e8360-daa4-4545-851a-b4f32b3bf094 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] Calling method '.version_select at 0x7f7bc5756d30>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:38.442836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-be1e8360-daa4-4545-851a-b4f32b3bf094 tempest-TestMinimumBasicScenario-1608082827 tempest-TestMinimumBasicScenario-1608082827-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-479145482" status: 202 len: 0 microversion: 2.1 time: 0.080961 May 26 21:35:38.443420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 507/970] 10.222.0.42 () {58 vars in 1268 bytes} [Thu May 26 21:35:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-479145482 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:35:38.740795 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-4386289f-e79d-49b1-bcdb-34e12745695b req-6b5f1753-60d0-455c-8f14-88d3d62c19c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9", "name": "network-vif-deleted", "tag": "b2321d87-7db4-4cc6-a9c8-6caeb967992e"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:38.748946 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-4386289f-e79d-49b1-bcdb-34e12745695b req-6b5f1753-60d0-455c-8f14-88d3d62c19c1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:38.749507 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-4386289f-e79d-49b1-bcdb-34e12745695b req-6b5f1753-60d0-455c-8f14-88d3d62c19c1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:38.760512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-4386289f-e79d-49b1-bcdb-34e12745695b req-6b5f1753-60d0-455c-8f14-88d3d62c19c1 service nova] Creating event network-vif-deleted:b2321d87-7db4-4cc6-a9c8-6caeb967992e for instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 on hv-cinder-82880 May 26 21:35:38.766027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-4386289f-e79d-49b1-bcdb-34e12745695b req-6b5f1753-60d0-455c-8f14-88d3d62c19c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028809 May 26 21:35:38.766819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 464/971] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:35:39.169874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:39.170474 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:39.177368 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:39.178110 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:39.178761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:39.179200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:39.215391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:39.215890 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:39.216346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lazy-loading 'fault' on Instance uuid 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:39.258141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4307a7bdf84fe18efd6ba3dbe50c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318999cb1f874176b2523de9686febc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:39.265088 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5db570a3-6d33-4df4-818e-0261ba96de7a tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 200 len: 1311 microversion: 2.1 time: 0.099568 May 26 21:35:39.265652 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 508/972] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:39 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:40.283142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:40.283789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] [instance: 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:40.290601 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:40.291058 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:40.291872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:40.292328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:40.306843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] HTTP exception thrown: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 could not be found. May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Request method failure captured: May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 HTTP/1.1 May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_C0GQ-INvXduMwRGm3c4_grfgBDzDAf36288IjzTjUlGN5KOZEPTFz1tsu5su5_qXahLBmX-nMCklW5U-v5JAVsuvZ9bMUL1HpZ0TlBEfT1Z3537_WDj0yIeFhry6wX2_uaUprVJOTtyS2h_zAdtBoy5cowHpeB5CvHyF_ShVtbKrc May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 318999cb1f874176b2523de9686febc1 May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:35:40.308551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_318999cb1f874176b2523de9686febc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/318999cb1f874176b2523de9686febc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/318999cb1f874176b2523de9686febc1"}]}] May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 318999cb1f874176b2523de9686febc1 May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943305167 May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: ee4307a7bdf84fe18efd6ba3dbe50c23 May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943305167-project May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 could not be found. May 26 21:35:40.310066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9'} May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 could not be found. May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:40.311004 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 could not be found. May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 could not be found. May 26 21:35:40.312594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:40.313929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] Returning 404 to user: Instance 5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:40.313929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-612bfc09-56c6-4327-9e07-e09c38d57bab tempest-ServerRescueNegativeTestJSON-1943305167 tempest-ServerRescueNegativeTestJSON-1943305167-project] 10.222.0.42 "GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9" status: 404 len: 111 microversion: 2.1 time: 0.031834 May 26 21:35:40.313929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 465/973] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:40 2022] GET /compute/v2.1/servers/5e4ce904-4beb-4fe0-87a1-e9c310f7d0a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:35:46.304861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8109e29b-26e1-43ea-a40a-b5c97a9d99c9 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Action: 'create', calling method: .version_select at 0x7f7bc5259790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1976495068", "metadata": {"Type": "work"}}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8109e29b-26e1-43ea-a40a-b5c97a9d99c9 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Request method failure captured: May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 122 May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_KyxZXHRPVRGjTOqZvBSYMKIvN1E4DkowfiV89k9tJ-bzEyhnaRGTiTOVRb0_vioQry_ggRo0kjKXE2kc8sH2vRRQb3DYoLoQydaIn2HT1eZj3NysH1-odPL-r2TJOBOw1CDkT3VtodVkEEvvUarneHR4VSlu0XPUIdFwkKjvOjOHg May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:35:46.326414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56afe02ca308499fb9665afab9406476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56afe02ca308499fb9665afab9406476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}] May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: d27461356c4d4356a9d964c9d7cf252a May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1976495068", "metadata": {"Type": "work"}}} May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: May 26 21:35:46.328491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1976495068', 'metadata': {'Type': 'work'}}}} May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise error May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi '#$%' May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:46.329292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 21:35:46.331057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 21:35:46.332479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 21:35:46.332479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.332479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8109e29b-26e1-43ea-a40a-b5c97a9d99c9 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:46.332479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8109e29b-26e1-43ea-a40a-b5c97a9d99c9 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.159042 May 26 21:35:46.332479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 509/974] 10.222.0.42 () {60 vars in 1155 bytes} [Thu May 26 21:35:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:35:46.340556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7a9ce2cf-ce8f-42a5-b946-4dfbeb603ac1 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Action: 'create', calling method: .version_select at 0x7f7bc4b46430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-169621554", "metadata": {"Type": "work"}}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7a9ce2cf-ce8f-42a5-b946-4dfbeb603ac1 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Request method failure captured: May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 119 May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_KyxZXHRPVRGjTOqZvBSYMKIvN1E4DkowfiV89k9tJ-bzEyhnaRGTiTOVRb0_vioQry_ggRo0kjKXE2kc8sH2vRRQb3DYoLoQydaIn2HT1eZj3NysH1-odPL-r2TJOBOw1CDkT3VtodVkEEvvUarneHR4VSlu0XPUIdFwkKjvOjOHg May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:35:46.344753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56afe02ca308499fb9665afab9406476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56afe02ca308499fb9665afab9406476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}] May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: d27461356c4d4356a9d964c9d7cf252a May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-169621554", "metadata": {"Type": "work"}}} May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: May 26 21:35:46.346204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-169621554', 'metadata': {'Type': 'work'}}}} May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise error May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi '0' May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:46.347100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 21:35:46.353309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 21:35:46.355207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 21:35:46.355207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.355207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7a9ce2cf-ce8f-42a5-b946-4dfbeb603ac1 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:46.355207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7a9ce2cf-ce8f-42a5-b946-4dfbeb603ac1 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009747 May 26 21:35:46.355207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 466/975] 10.222.0.42 () {60 vars in 1155 bytes} [Thu May 26 21:35:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 21:35:46.362835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-94cd9b6a-85a4-4e50-a7bd-44a255500258 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Action: 'create', calling method: .version_select at 0x7f7bc52a4af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-970891613", "metadata": {"Type": "work"}}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-94cd9b6a-85a4-4e50-a7bd-44a255500258 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Request method failure captured: May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 118 May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_KyxZXHRPVRGjTOqZvBSYMKIvN1E4DkowfiV89k9tJ-bzEyhnaRGTiTOVRb0_vioQry_ggRo0kjKXE2kc8sH2vRRQb3DYoLoQydaIn2HT1eZj3NysH1-odPL-r2TJOBOw1CDkT3VtodVkEEvvUarneHR4VSlu0XPUIdFwkKjvOjOHg May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:35:46.365332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56afe02ca308499fb9665afab9406476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56afe02ca308499fb9665afab9406476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}] May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: d27461356c4d4356a9d964c9d7cf252a May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-970891613", "metadata": {"Type": "work"}}} May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: May 26 21:35:46.367063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-970891613', 'metadata': {'Type': 'work'}}}} May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise error May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi '' May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:46.368086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 21:35:46.369645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 21:35:46.371603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 21:35:46.371603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.371603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-94cd9b6a-85a4-4e50-a7bd-44a255500258 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:46.372878 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-94cd9b6a-85a4-4e50-a7bd-44a255500258 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014364 May 26 21:35:46.373579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 510/976] 10.222.0.42 () {60 vars in 1155 bytes} [Thu May 26 21:35:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:35:46.383836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-648b5d81-5da7-49d8-973d-c6e4df97572e tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Calling method '.version_select at 0x7f7bc4d878b0>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:46.419967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-648b5d81-5da7-49d8-973d-c6e4df97572e tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] HTTP exception thrown: Volume tempest-invalid-2113783243 could not be found. May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-648b5d81-5da7-49d8-973d-c6e4df97572e tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Request method failure captured: May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2113783243 HTTP/1.1 May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_KyxZXHRPVRGjTOqZvBSYMKIvN1E4DkowfiV89k9tJ-bzEyhnaRGTiTOVRb0_vioQry_ggRo0kjKXE2kc8sH2vRRQb3DYoLoQydaIn2HT1eZj3NysH1-odPL-r2TJOBOw1CDkT3VtodVkEEvvUarneHR4VSlu0XPUIdFwkKjvOjOHg May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:35:46.422478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56afe02ca308499fb9665afab9406476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56afe02ca308499fb9665afab9406476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}] May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: d27461356c4d4356a9d964c9d7cf252a May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Volume tempest-invalid-2113783243 could not be found. May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': 'tempest-invalid-2113783243'} May 26 21:35:46.424674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2113783243 could not be found. (HTTP 404) (Request-ID: req-d2e3379c-baf1-4356-883f-9b52da956155) May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.425735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:35:46.427215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2113783243 could not be found. May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:46.429385 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2113783243 could not be found. May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2113783243 could not be found. May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-648b5d81-5da7-49d8-973d-c6e4df97572e tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Returning 404 to user: Volume tempest-invalid-2113783243 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:46.431556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-648b5d81-5da7-49d8-973d-c6e4df97572e tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2113783243" status: 404 len: 99 microversion: 2.1 time: 0.044417 May 26 21:35:46.434437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b3038f69-cc83-4c59-be6c-66536ad55353 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004119 May 26 21:35:46.435167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 511/977] 10.222.0.42 () {58 vars in 1139 bytes} [Thu May 26 21:35:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 21:35:46.440506 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 467/978] 10.222.0.42 () {58 vars in 1217 bytes} [Thu May 26 21:35:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2113783243 => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 21:35:46.446891 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9e0438cd-c8bf-481e-a9ad-6539ca0075f5 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004956 May 26 21:35:46.447407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 512/979] 10.222.0.42 () {58 vars in 1136 bytes} [Thu May 26 21:35:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 26 21:35:46.457715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-54df70cd-ae4a-44e1-974b-9439e1d0d667 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Calling method '.version_select at 0x7f7bc4b06f70>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:46.490832 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-54df70cd-ae4a-44e1-974b-9439e1d0d667 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] HTTP exception thrown: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-54df70cd-ae4a-44e1-974b-9439e1d0d667 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Request method failure captured: May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/os-volumes/e94f3def-ef83-4f15-8bcf-3adc8e9890be HTTP/1.1 May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_KyxZXHRPVRGjTOqZvBSYMKIvN1E4DkowfiV89k9tJ-bzEyhnaRGTiTOVRb0_vioQry_ggRo0kjKXE2kc8sH2vRRQb3DYoLoQydaIn2HT1eZj3NysH1-odPL-r2TJOBOw1CDkT3VtodVkEEvvUarneHR4VSlu0XPUIdFwkKjvOjOHg May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:35:46.493902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56afe02ca308499fb9665afab9406476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56afe02ca308499fb9665afab9406476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}] May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: d27461356c4d4356a9d964c9d7cf252a May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': 'e94f3def-ef83-4f15-8bcf-3adc8e9890be'} May 26 21:35:46.495901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. (HTTP 404) (Request-ID: req-60b14de2-ce86-4208-bc41-3b00b6b5a0a4) May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.496987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:35:46.498383 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 21:35:46.502910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-54df70cd-ae4a-44e1-974b-9439e1d0d667 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Returning 404 to user: Volume e94f3def-ef83-4f15-8bcf-3adc8e9890be could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-54df70cd-ae4a-44e1-974b-9439e1d0d667 tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e94f3def-ef83-4f15-8bcf-3adc8e9890be" status: 404 len: 109 microversion: 2.1 time: 0.044862 May 26 21:35:46.504350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 468/980] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:35:46 2022] DELETE /compute/v2.1/os-volumes/e94f3def-ef83-4f15-8bcf-3adc8e9890be => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:35:46.511372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cdee6030-52fb-451a-8d07-771b7823132f tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Calling method '.version_select at 0x7f7bc52a4940>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:46.542315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-cdee6030-52fb-451a-8d07-771b7823132f tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] HTTP exception thrown: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cdee6030-52fb-451a-8d07-771b7823132f tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Request method failure captured: May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/os-volumes/83c48298-44ad-4b73-9219-0f81be9131d2 HTTP/1.1 May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_KyxZXHRPVRGjTOqZvBSYMKIvN1E4DkowfiV89k9tJ-bzEyhnaRGTiTOVRb0_vioQry_ggRo0kjKXE2kc8sH2vRRQb3DYoLoQydaIn2HT1eZj3NysH1-odPL-r2TJOBOw1CDkT3VtodVkEEvvUarneHR4VSlu0XPUIdFwkKjvOjOHg May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:35:46.544558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56afe02ca308499fb9665afab9406476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56afe02ca308499fb9665afab9406476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56afe02ca308499fb9665afab9406476"}]}] May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 56afe02ca308499fb9665afab9406476 May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesNegativeTest-2105211336 May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: d27461356c4d4356a9d964c9d7cf252a May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesNegativeTest-2105211336-project May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '83c48298-44ad-4b73-9219-0f81be9131d2'} May 26 21:35:46.546138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. (HTTP 404) (Request-ID: req-ba2d7d1d-9c22-4312-ab12-ff19b68c609b) May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.547315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:35:46.548638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:35:46.549957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. May 26 21:35:46.551262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:35:46.552998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cdee6030-52fb-451a-8d07-771b7823132f tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] Returning 404 to user: Volume 83c48298-44ad-4b73-9219-0f81be9131d2 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:35:46.553853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cdee6030-52fb-451a-8d07-771b7823132f tempest-VolumesNegativeTest-2105211336 tempest-VolumesNegativeTest-2105211336-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/83c48298-44ad-4b73-9219-0f81be9131d2" status: 404 len: 109 microversion: 2.1 time: 0.046546 May 26 21:35:46.555837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 513/981] 10.222.0.42 () {58 vars in 1244 bytes} [Thu May 26 21:35:46 2022] GET /compute/v2.1/os-volumes/83c48298-44ad-4b73-9219-0f81be9131d2 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:35:55.980942 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:55.981699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:55.987422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:35:55.987995 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:55.997391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:55.997391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:55.997391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:55.997391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:56.034175 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lazy-loading 'flavor' on Instance uuid 7586f603-aaac-433d-85db-77c2893aa328 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:35:56.350922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1c0c3007-b88a-4bc3-b2be-a0f0fb5f6850 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "POST /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328/action" status: 202 len: 0 microversion: 2.1 time: 0.371019 May 26 21:35:56.351531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 469/982] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:35:55 2022] POST /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:35:56.359827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:56.360823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:56.364549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:56.365283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=36 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:35:56.370369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:56.370831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:56.373900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:56.373900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:56.506765 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:56.514375 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-24272173-9f67-4353-8b7b-e8a076a14f18 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.158391 May 26 21:35:56.515036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 514/983] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:56 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:57.533031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:57.533814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:57.541490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:57.541941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:57.542736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:57.543224 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:57.684511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:57.693328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-72c97bcd-9e3c-4dc8-a935-995327821e38 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.165632 May 26 21:35:57.693987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 470/984] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:57 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:58.710847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:58.711822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:58.721024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:58.724538 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:58.724538 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:58.724538 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:58.858465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:35:58.866103 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-02bd4424-6a61-4565-b45c-f14cb116db0f tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.159287 May 26 21:35:58.866664 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 515/985] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:58 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:35:59.882891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:35:59.883485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:35:59.890402 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:59.890856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:35:59.891680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:35:59.892151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:00.024938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:00.030956 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-38e69a92-7591-4ba7-b58e-98a495ea8c2e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.151917 May 26 21:36:00.031523 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 471/986] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:35:59 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:01.048006 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:01.048579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:01.055148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:01.055598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:01.056397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:01.056836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:01.186857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:01.194494 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b1aee164-a083-4889-8c25-d596e15af994 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.150930 May 26 21:36:01.195057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 516/987] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:01 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:02.211952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:02.212567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:02.219063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:02.220044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:02.220810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:02.221249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:02.354005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:02.362499 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-eafc8b80-09c0-4dbd-a58a-15140689f7e9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.154476 May 26 21:36:02.363054 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 472/988] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:02 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:03.378985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:03.379601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:03.386097 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:03.386549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:03.387322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:03.387856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:03.514562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:03.522650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-348ada20-54f5-4b72-9606-b81b91ffdae0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.148222 May 26 21:36:03.523223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 517/989] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:03 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:04.539132 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:04.539736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:04.546454 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:04.547164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:04.548511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:04.548952 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:04.768292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:04.776239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d2c4caf3-11fd-4e0d-85e6-c799e6e245d7 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.240846 May 26 21:36:04.776570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 473/990] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:04 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:05.794043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:05.794848 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:05.802206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:05.802661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:05.803435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:05.803910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:05.940087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:05.947640 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-234a2e37-11a7-44ed-8f51-9ee9f9d30d0e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.157801 May 26 21:36:05.948231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 518/991] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:05 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:06.965115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:06.965737 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:06.972320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.973366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.974150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.974592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:07.112361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:07.119873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6d5d3b25-b1e3-4b0b-b35e-457971e7c2d3 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.158862 May 26 21:36:07.120471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 474/992] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:06 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:08.136861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:08.137467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:08.144009 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:08.145134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:08.145902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:08.146444 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:08.279337 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:08.287118 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f9d5e5b3-a187-471f-877a-8705dd13f5c4 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.154176 May 26 21:36:08.287686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 519/993] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:08 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:09.304617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:09.305259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:09.311980 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:09.312468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:09.313198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:09.313639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:09.447651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:09.460100 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8473f648-13a8-4709-85c9-62af81e6359e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.159453 May 26 21:36:09.460669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 475/994] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:09 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:10.477315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:10.478212 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:10.485275 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:10.485737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:10.486518 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:10.486964 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:10.623840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:10.632305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3b8c75f2-1179-4c3c-bb41-744938b699e0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.159064 May 26 21:36:10.633064 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 520/995] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:10 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:11.650522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:11.651066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:11.657679 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:11.657966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:11.658748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:11.659181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:11.884248 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:11.891935 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-60549ea1-c75c-4a02-a17c-9a51401e52b0 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.245964 May 26 21:36:11.892815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 476/996] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:11 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:12.909556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:12.910232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:12.916801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:12.917255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:12.918028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:12.918469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:13.053340 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:13.060917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4834b303-6615-4174-8902-9237beceff88 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.155256 May 26 21:36:13.061516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 521/997] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:12 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:14.081083 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:14.082253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:14.088784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:14.089237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:14.090005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:14.090446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:14.228857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:14.236575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9786a476-28fb-4b8e-b935-897b06e286cb tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.159549 May 26 21:36:14.237129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 477/998] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:14 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:15.254887 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:15.255478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:15.262346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:15.262802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:15.263578 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:15.264189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:15.396261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:15.403875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b5608d96-94d6-419e-9c9d-2896f9272842 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1569 microversion: 2.1 time: 0.153551 May 26 21:36:15.404442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 522/999] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:15 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:15.420085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:36:15.420649 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:15.427949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:15.428395 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:15.429178 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:15.429614 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:15.661806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-43799449-734b-4e81-bd0e-530dc0ecd1f9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "POST /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328/action" status: 202 len: 0 microversion: 2.1 time: 0.245710 May 26 21:36:15.664066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 478/1000] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:36:15 2022] POST /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:36:15.671024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:15.672676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:15.679017 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:15.679462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:15.680292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:15.680728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:15.814889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:15.822552 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d615fbde-aee3-4f4b-9367-ac63a3965eba tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1517 microversion: 2.1 time: 0.155387 May 26 21:36:15.823124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 523/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:15 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:16.840673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:16.841216 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:16.847198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:16.847652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:16.848446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:16.848877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:16.976345 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:16.984243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-66c465d7-7262-4989-904d-b4af44bf6e42 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1517 microversion: 2.1 time: 0.148001 May 26 21:36:16.984838 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 479/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:16 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:18.000839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:18.001478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:18.008187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:18.008639 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:18.009407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:18.009865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:18.142881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:18.150762 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ae3ffee0-e9bf-4289-922d-a18d9fa2670e tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1517 microversion: 2.1 time: 0.153755 May 26 21:36:18.155494 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 524/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:17 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:19.167283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:19.167919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:19.174432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:19.174881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:19.175642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:19.176109 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:19.314648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:19.318235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-858d7db0-1989-4fd7-9ddb-82ec1741d505 req-f6b1734c-2585-4c9a-9c68-f3cff2c88f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "name": "network-vif-unplugged", "status": "completed", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:36:19.323091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-90129f09-179b-47a3-a0d4-c9ff23c2cb19 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1519 microversion: 2.1 time: 0.159393 May 26 21:36:19.323681 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 480/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:19 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:19.332310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-858d7db0-1989-4fd7-9ddb-82ec1741d505 req-f6b1734c-2585-4c9a-9c68-f3cff2c88f4d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:19.332310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-858d7db0-1989-4fd7-9ddb-82ec1741d505 req-f6b1734c-2585-4c9a-9c68-f3cff2c88f4d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:19.343116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.compute.server_external_events [req-858d7db0-1989-4fd7-9ddb-82ec1741d505 req-f6b1734c-2585-4c9a-9c68-f3cff2c88f4d service nova] Unable to find a host for instance 7586f603-aaac-433d-85db-77c2893aa328. Dropping event network-vif-unplugged {{(pid=118557) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 21:36:19.344047 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-858d7db0-1989-4fd7-9ddb-82ec1741d505 req-f6b1734c-2585-4c9a-9c68-f3cff2c88f4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031080 May 26 21:36:19.344655 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 525/1005] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 21:36:20.341836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:20.343982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:20.351170 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:20.351630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:20.352475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:20.352967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:20.488812 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:20.496843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e5aaa178-0a73-4a60-81be-262b5afb743a tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1519 microversion: 2.1 time: 0.159241 May 26 21:36:20.497451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 481/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:20 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:21.514139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:21.514745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:21.521283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:21.521728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:21.522500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:21.522937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:21.654030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:21.662123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8843e0bd-a778-42fa-b378-fe08d66ff965 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.151354 May 26 21:36:21.662694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 526/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:21 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:22.679000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:22.679594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:22.686216 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:22.686665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:22.687433 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:22.687895 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:22.710179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:22.817167 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:22.825512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-483e5683-4cd7-4308-84ba-70c6d7318399 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.150959 May 26 21:36:22.826079 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 482/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:22 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:23.842454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:23.843068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:23.849673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:23.850142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:23.850938 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:23.851349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:23.981271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:23.988822 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bdc4bd92-e45c-4f19-8ef5-b0e0931bb347 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.150374 May 26 21:36:23.989389 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 527/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:23 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:25.006570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:25.007181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:25.013772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:25.014227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:25.015005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:25.015449 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:25.148204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:25.151981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-daa06df0-7b94-4369-a32e-ca71182d9b66 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.149942 May 26 21:36:25.152553 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 483/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:25 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:26.169143 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:26.169910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:26.180770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:26.180770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:26.180770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:26.180770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:26.313248 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:26.321445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bcc2c7cc-6807-428f-bc07-389c2e278e6b tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.156384 May 26 21:36:26.322020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 528/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:26 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:27.338453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:27.339176 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:27.345828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:27.346273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:27.347035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:27.347468 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:27.481398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:27.489192 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-80fd446b-2daa-4e04-8662-543561aeffe9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.154519 May 26 21:36:27.490363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 484/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:27 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:28.506714 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:28.507324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:28.514038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:28.514516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:28.515292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:28.515730 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:28.645661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:28.653252 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-85dc8630-cf3d-454c-ac4a-8b1fe0c7a5bf tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.150999 May 26 21:36:28.653831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 529/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:28 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:29.670650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:29.671540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:29.673989 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=35 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:29.678833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:29.679285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:29.680086 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:29.680524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:29.808417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:29.816069 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4d6b899d-2686-4ca9-a930-96c571d0112d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.149437 May 26 21:36:29.816633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 485/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:29 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:30.833868 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:30.834479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:30.836859 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=33 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:30.841718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:30.842168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:30.842934 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:30.843373 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:30.845973 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=93 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:30.972907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:30.982749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f22d8229-d856-49e9-bc2f-295e30a53182 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.153230 May 26 21:36:30.983326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 530/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:30 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:31.999422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:32.000065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:32.007091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:32.007543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:32.008337 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:32.008810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:32.139031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:32.146511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cd1f6c9a-fe16-43da-8c39-18fc31b9c9a5 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.151104 May 26 21:36:32.147067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 486/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:31 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:33.163487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:33.164085 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:33.170571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:33.171021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:33.172085 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:33.172524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:33.305424 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:33.312919 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-224c61bc-2129-45f1-aa9a-749c36121561 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.153392 May 26 21:36:33.313488 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 531/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:33 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:34.330518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:34.331160 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:34.338393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:34.338841 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:34.339612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:34.340084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:34.469716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:34.477381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7a35c6a9-5cd4-4ad0-84c5-46eda7f6618d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.150821 May 26 21:36:34.477941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 487/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:34 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:35.493772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:35.494375 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:35.500983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:35.501436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:35.502199 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:35.502648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:35.632093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:35.639684 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d2ded5d9-a196-488b-a6b0-b553c67dbb61 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.149758 May 26 21:36:35.640364 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 532/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:35 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:36.657388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:36.658090 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:36.665045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:36.665489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:36.666251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:36.666682 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:36.794180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:36.802616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c6305a2a-5af3-4cd7-ab35-514b29460789 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.148526 May 26 21:36:36.803182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 488/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:36 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:37.819726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:37.820365 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:37.827021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:37.827472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:37.828262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:37.828732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:37.965984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:37.973474 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-eef25349-e9d6-4753-be86-5e8cf1bd21af tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.157701 May 26 21:36:37.974263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 533/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:37 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:38.991061 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:38.991760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:38.998426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:38.998873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:38.999674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:39.000137 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:39.375565 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:39.383811 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f7c2df01-d119-47b1-84cf-ad909db70b36 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.397200 May 26 21:36:39.384688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 489/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:38 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:39.509175 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-985e4d60-11e7-4942-9c99-67782121ea5b req-22e347e4-2c79-4c16-a617-3b8e7f443ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:36:39.518298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-985e4d60-11e7-4942-9c99-67782121ea5b req-22e347e4-2c79-4c16-a617-3b8e7f443ea1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:39.518784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-985e4d60-11e7-4942-9c99-67782121ea5b req-22e347e4-2c79-4c16-a617-3b8e7f443ea1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:39.533007 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-985e4d60-11e7-4942-9c99-67782121ea5b req-22e347e4-2c79-4c16-a617-3b8e7f443ea1 service nova] Creating event network-vif-plugged:5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a for instance 7586f603-aaac-433d-85db-77c2893aa328 on hv-cinder-82880 May 26 21:36:39.538545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-985e4d60-11e7-4942-9c99-67782121ea5b req-22e347e4-2c79-4c16-a617-3b8e7f443ea1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 May 26 21:36:39.539262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 534/1023] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:36:40.400792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:40.401399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:40.408018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:40.408478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:40.409271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:40.409705 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:40.544942 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:40.553382 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9717a858-0a03-43e1-bacc-26fc1096f856 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1575 microversion: 2.1 time: 0.156471 May 26 21:36:40.553955 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 490/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:40 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:41.571382 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:41.572906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:41.580338 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:41.584202 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:41.585356 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:41.585569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:41.725490 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:41.733457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-da631c17-06a8-4f9d-816d-92975e98a5ea tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1562 microversion: 2.1 time: 0.166886 May 26 21:36:41.734026 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 535/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:36:41 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:51.299484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:51.300089 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:51.302439 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=11 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:51.303521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=50 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:51.310156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:51.310704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:51.311723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:51.312317 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:51.343966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c4f557c5-2579-42bc-8a10-e22a02c5a031 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/ips" status: 200 len: 152 microversion: 2.20 time: 0.049767 May 26 21:36:51.344726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 491/1026] 10.222.0.42 () {60 vars in 1288 bytes} [Thu May 26 21:36:51 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:36:53.523536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:36:53.524467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:53.526626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=11 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:53.527277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=31 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:53.532200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:53.532657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:53.533431 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:53.533878 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:53.558425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lazy-loading 'flavor' on Instance uuid d396708c-5036-4133-a056-0f74ecc6011a {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:36:54.240948 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ea3f57d6-28d7-4b1a-9ecc-8796f854da12 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/action" status: 202 len: 0 microversion: 2.20 time: 0.721700 May 26 21:36:54.248775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 536/1027] 10.222.0.42 () {62 vars in 1318 bytes} [Thu May 26 21:36:53 2022] POST /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:36:54.251347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:54.251991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:54.259233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:54.259633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:54.260493 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:54.260939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:54.409151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:54.417905 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:54.419695 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:54.420837 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fbf36970-3052-4b1d-8ba0-394f6119eae3 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.175054 May 26 21:36:54.421672 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 492/1028] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:36:54 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:36:55.116050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:55.116618 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:55.123865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:55.124369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:55.125141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:55.125578 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:55.149124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-da9beb75-d275-42d7-90f5-89fe5b38bd96 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/ips" status: 200 len: 148 microversion: 2.1 time: 0.037792 May 26 21:36:55.149727 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 537/1029] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:36:55 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:36:55.439470 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:55.440110 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:55.447240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:55.447700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:55.448513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:55.448959 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:55.576764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:55.584949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:55.586489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:55.588193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-97d73a3e-fb76-4c05-a363-8b57d6309105 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.152677 May 26 21:36:55.588760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 493/1030] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:36:55 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:36:56.606728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:56.607332 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:56.614427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:56.614874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:56.615678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:56.616142 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:56.720546 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d601aa-da09-4e80-8d5b-961e9418bb51"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:36:56.721722 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:56.728592 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:56.729048 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:56.729821 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:56.730259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:56.914294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:56.922864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:56.924470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:56.925690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-81bb4789-c991-4792-9dbe-b47a57a40d45 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.322996 May 26 21:36:56.926276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 538/1031] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:36:56 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:36:57.497159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-faebcabd-de47-4aa8-b44a-1bc5604f8b7f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780425 May 26 21:36:57.497785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 494/1032] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:36:56 2022] POST /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:36:57.944506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:57.945228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:57.952020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:57.952477 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:57.953305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:57.953748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:58.084203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:58.093063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:58.095108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:58.095893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d89680eb-e3a3-4325-bc5e-73fe97ce3905 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.155501 May 26 21:36:58.096455 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 539/1033] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:36:57 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:36:59.115236 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:59.115960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:59.122232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:59.122683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:59.123451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:59.123925 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:59.251873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:59.259940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:59.262128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:59.263309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-64eb7905-d92b-42ab-b5f2-5e941ac9e0db tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.152877 May 26 21:36:59.263891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 495/1034] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:36:59 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:36:59.815411 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:36:59.816028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:36:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:37:00.281240 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:00.281845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:00.288951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:00.289406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:00.290176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:00.290615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:00.422988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:00.430900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:00.432479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:00.433687 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-75e3329f-8d13-415a-a0a8-465ba70a3d64 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.156994 May 26 21:37:00.434242 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 540/1035] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:00 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:01.452185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:01.452789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:01.459360 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:01.459839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:01.460615 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:01.461060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:01.590270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:01.598239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:01.599803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:01.600972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0fc9822d-bdc0-4b78-a9fc-4b26806b9239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.153362 May 26 21:37:01.601539 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 496/1036] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:01 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:02.618571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:02.619116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:02.626000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:02.626507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:02.627309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:02.627775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:02.760348 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:02.768998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:02.770551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:02.771736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-77b39ff2-71b0-48f4-a33b-43f371130279 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.157196 May 26 21:37:02.775721 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 541/1037] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:02 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:03.790387 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:03.791315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:03.803313 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:03.803807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:03.804582 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:03.805012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:03.943081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:03.951151 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:03.958784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:03.958784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8ca7a5df-bf38-4525-a68a-38a8424f4781 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.167672 May 26 21:37:03.958784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 497/1038] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:03 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:04.975048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:04.975608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:04.982427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:04.982874 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:04.983672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:04.984143 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:05.112352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:05.121051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:05.123146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:05.124441 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-add4a5c1-6208-4fb5-bb08-49124e7ad7c5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.153488 May 26 21:37:05.125010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 542/1039] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:04 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:06.050266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d601aa-da09-4e80-8d5b-961e9418bb51"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:06.051369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:06.058013 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.058460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.059217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.059650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.137123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Invalid volume: volume 17d601aa-da09-4e80-8d5b-961e9418bb51 is already attached to instances: 31344c9e-84b8-4fc4-9804-30732b08d70e May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: POST /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments HTTP/1.1 May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 74 May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:37:06.138966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {"volumeAttachment": {"volumeId": "17d601aa-da09-4e80-8d5b-961e9418bb51"}} May 26 21:37:06.140490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Invalid volume: volume 17d601aa-da09-4e80-8d5b-961e9418bb51 is already attached to instances: 31344c9e-84b8-4fc4-9804-30732b08d70e May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'server_id': '31344c9e-84b8-4fc4-9804-30732b08d70e', 'body': {'volumeAttachment': {'volumeId': '17d601aa-da09-4e80-8d5b-961e9418bb51'}}} May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17d601aa-da09-4e80-8d5b-961e9418bb51 is already attached to instances: 31344c9e-84b8-4fc4-9804-30732b08d70e May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:06.141276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17d601aa-da09-4e80-8d5b-961e9418bb51 is already attached to instances: 31344c9e-84b8-4fc4-9804-30732b08d70e May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:37:06.142563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17d601aa-da09-4e80-8d5b-961e9418bb51 is already attached to instances: 31344c9e-84b8-4fc4-9804-30732b08d70e May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 400 to user: Invalid volume: volume 17d601aa-da09-4e80-8d5b-961e9418bb51 is already attached to instances: 31344c9e-84b8-4fc4-9804-30732b08d70e {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1a139ddf-d267-4aca-88dd-887ff49ac702 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094509 May 26 21:37:06.143843 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 498/1040] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:37:06 2022] POST /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:37:06.209429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:06.210400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:06.216651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.217107 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.217878 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.218322 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.288489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:06.289104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:06.295264 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.296003 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.296782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.297219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.299710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'services' on Instance uuid 31344c9e-84b8-4fc4-9804-30732b08d70e {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:37:06.427315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:06.435299 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:06.438899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:06.438899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fd951e1f-ca3e-4de9-9b2b-dca135f44bc5 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.299453 May 26 21:37:06.438899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 543/1041] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:06 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:06.543632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f4d338bc-cd6a-42c1-b1a3-682730fed606 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments/17d601aa-da09-4e80-8d5b-961e9418bb51" status: 202 len: 0 microversion: 2.1 time: 0.338016 May 26 21:37:06.544378 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 499/1042] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:37:06 2022] DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments/17d601aa-da09-4e80-8d5b-961e9418bb51 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:37:06.553065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:06.554115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:06.560077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.560531 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.561298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:06.561739 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:06.592921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1995e9ca-b122-47d0-876e-eaca9dffd666 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 May 26 21:37:06.593497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 544/1043] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:37:06 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:37:07.457596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:07.458287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:07.464654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:07.467579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:07.467579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:07.467579 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:07.605308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:07.606335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:07.606648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:07.613795 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:07.614244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:07.615263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:07.615391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:07.615662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:07.617598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:07.618789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dcef0d72-d952-4b0d-9d34-2f79c8cc63fc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.166073 May 26 21:37:07.619540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 500/1044] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:07 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:07.647734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-47a77a94-76d1-4f51-91a9-b5e86c27bc53 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046811 May 26 21:37:07.648304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 545/1045] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:37:07 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 21:37:07.708726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:07.709231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:07.715602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:07.716102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:07.716879 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:07.717318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:07.743320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:37:08.046075 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e69de958-61d2-48eb-854e-5f43926fa906 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 204 len: 0 microversion: 2.1 time: 0.340740 May 26 21:37:08.046560 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 501/1046] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:37:07 2022] DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:37:08.054851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:08.055466 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:08.061713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:08.062177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:08.062958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:08.063398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:08.192577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:08.200710 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5b55f505-c5ae-45ac-9f35-4f3d0db684b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1678 microversion: 2.1 time: 0.149867 May 26 21:37:08.201277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 546/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:08 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:08.638275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:08.638979 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:08.645535 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:08.646024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:08.646757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:08.647217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:08.773827 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:08.781756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:08.783280 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:08.784477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6470f220-4de4-488b-b3b9-7db16f82a102 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.150645 May 26 21:37:08.785033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 502/1048] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:08 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:09.217397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:09.217997 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:09.224801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:09.225254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:09.226033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:09.226478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:09.606808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:09.614728 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9650f9d1-24c2-47dc-a929-4836ee8e1ee3 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1678 microversion: 2.1 time: 0.401692 May 26 21:37:09.615305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 547/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:09 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:09.802992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:09.803600 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:09.810633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:09.811085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:09.811880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:09.812328 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:09.955168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:09.961872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:09.963546 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:09.964760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7704446b-606e-4f59-a246-7c70342bed73 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.165745 May 26 21:37:09.965316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 503/1050] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:09 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:10.632597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:10.633213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:10.640622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:10.641067 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:10.641835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:10.642268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:10.708183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:10.715520 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ff1a0741-5467-4728-b085-de0dae51bce5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1612 microversion: 2.1 time: 0.086882 May 26 21:37:10.716123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 548/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:10 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:10.847052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-00bed3a0-8966-440b-9265-87eebb1c0b6c req-b987e12a-558d-43ff-9dd0-eb9c47484826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31344c9e-84b8-4fc4-9804-30732b08d70e", "name": "network-vif-deleted", "tag": "74b8602f-769d-4945-bc28-0333c237b868"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:10.855973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-00bed3a0-8966-440b-9265-87eebb1c0b6c req-b987e12a-558d-43ff-9dd0-eb9c47484826 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:10.856435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-00bed3a0-8966-440b-9265-87eebb1c0b6c req-b987e12a-558d-43ff-9dd0-eb9c47484826 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:10.866149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:10.868859 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-00bed3a0-8966-440b-9265-87eebb1c0b6c req-b987e12a-558d-43ff-9dd0-eb9c47484826 service nova] Creating event network-vif-deleted:74b8602f-769d-4945-bc28-0333c237b868 for instance 31344c9e-84b8-4fc4-9804-30732b08d70e on hv-cinder-82880 May 26 21:37:10.874365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-00bed3a0-8966-440b-9265-87eebb1c0b6c req-b987e12a-558d-43ff-9dd0-eb9c47484826 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031124 May 26 21:37:10.874963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 504/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:37:10.983698 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:10.984352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:10.994431 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:10.994894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:10.995735 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:10.996831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:11.151565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:11.160935 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:11.164133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:11.164133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ac0d01b8-b1ce-4a3e-a3a9-3064a1e6b2e7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.185029 May 26 21:37:11.173252 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 549/1053] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:10 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:11.733931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:11.734630 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:11.741438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:11.742209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:11.743163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:11.743602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:11.776819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:11.777346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:11.778367 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'fault' on Instance uuid 31344c9e-84b8-4fc4-9804-30732b08d70e {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:37:11.821348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:11.829422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f8a63305-a5dd-4d63-9ee9-9226266e0c88 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 200 len: 1331 microversion: 2.1 time: 0.100431 May 26 21:37:11.829982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 505/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:11 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:12.182475 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:12.183081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:12.190107 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:12.190561 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:12.191325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:12.191784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:12.322891 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:12.326344 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:12.331159 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:12.332690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:12.333840 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-47f262bb-5e63-4ea0-b9ab-486f34a164f6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1745 microversion: 2.20 time: 0.155303 May 26 21:37:12.334396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 550/1055] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:12 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:12.846835 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:12.847440 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:12.853877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:12.854324 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:12.855082 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:12.856274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:12.870113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e HTTP/1.1 May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:37:12.871764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:37:12.873405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '31344c9e-84b8-4fc4-9804-30732b08d70e'} May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:37:12.874230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:37:12.875528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:37:12.876902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:37:12.876902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e2d49370-197e-4c0c-9085-71827bcfb228 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 404 len: 111 microversion: 2.1 time: 0.030223 May 26 21:37:12.876902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 506/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:12 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:37:12.882510 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7581564a-4fa8-41df-8398-3a0045517ad0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '.version_select at 0x7f7bc5259c10>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:12.950647 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7581564a-4fa8-41df-8398-3a0045517ad0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751665930" status: 202 len: 0 microversion: 2.1 time: 0.072151 May 26 21:37:12.951233 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 551/1057] 10.222.0.42 () {58 vars in 1217 bytes} [Thu May 26 21:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751665930 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:37:13.352516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:13.353123 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:13.359035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:13.359487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:13.360288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:13.360721 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:13.490304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:13.499331 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:13.501086 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:13.502269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4a33c5ed-9847-4e46-b494-112010b707e8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1745 microversion: 2.20 time: 0.153765 May 26 21:37:13.502828 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 507/1058] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:13 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:13.707770 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e96b29b9-b18e-4cf3-a163-c771e51e5348 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: .version_select at 0x7f7bc54e3040>, body: {"keypair": {"name": "tempest-keypair-2111046698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0inB4dMr5O2Ng9jkdy7FrEQBqrXDPcYegpiwxebAHOK+c2DQ0Hj+37cIMMDMZtyGaErvCSCbOTAFm4BW3cmg/9YhC7w81H4eBHXWfFGy96ygeigrUR8Dy0AWajGugYTQ=="}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:13.722351 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-e96b29b9-b18e-4cf3-a163-c771e51e5348 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:37:13.726149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-e96b29b9-b18e-4cf3-a163-c771e51e5348 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:37:13.837686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e96b29b9-b18e-4cf3-a163-c771e51e5348 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134716 May 26 21:37:13.838300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 552/1059] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:37:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:37:14.521496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:14.522102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:14.528737 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:14.532965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:14.532965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:14.532965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:14.664154 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:14.673239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:14.674791 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:14.676002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4183dbca-f150-4c7f-a4e1-d8f286ffd151 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1745 microversion: 2.20 time: 0.158523 May 26 21:37:14.676877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 508/1060] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:14 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:15.663255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-1d152fbf-2b59-4c3e-9e00-0f80efe6f0f7 req-50641236-ca59-4495-a532-95690d3d5496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "name": "network-vif-plugged", "status": "completed", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:15.673259 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1d152fbf-2b59-4c3e-9e00-0f80efe6f0f7 req-50641236-ca59-4495-a532-95690d3d5496 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:15.680903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1d152fbf-2b59-4c3e-9e00-0f80efe6f0f7 req-50641236-ca59-4495-a532-95690d3d5496 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:15.685466 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-1d152fbf-2b59-4c3e-9e00-0f80efe6f0f7 req-50641236-ca59-4495-a532-95690d3d5496 service nova] Creating event network-vif-plugged:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:37:15.690781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-1d152fbf-2b59-4c3e-9e00-0f80efe6f0f7 req-50641236-ca59-4495-a532-95690d3d5496 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 May 26 21:37:15.691804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 553/1061] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:37:15.695076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:15.695683 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:15.704101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:15.704569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:15.705363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:15.705804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:15.858391 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:15.867084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:15.868743 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:15.869943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c52dd60b-1174-414d-b421-82a9b7645da2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1745 microversion: 2.20 time: 0.179164 May 26 21:37:15.878012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 509/1062] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:15 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:16.260078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-854704711", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e423d8c6-f848-40d6-99bb-c61a958058f7"}], "security_groups": [{"name": "tempest-securitygroup--238507321"}], "key_name": "tempest-keypair-2111046698", "user_data": "}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:16.362678 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] validate_networks() for [('e423d8c6-f848-40d6-99bb-c61a958058f7', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:37:16.774475 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:37:16.775061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:37:16.775393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:37:16.775832 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:37:16.776244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:37:16.785629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:16.786074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:16.786864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:16.787292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:16.804602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:37:16.808652 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Getting quotas for user 6214705ae31e459891f7a215f45a4cb2 and project 3969075d983246cf8c4c7a45a57d5338. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:37:16.819532 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:37:16.821988 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:37:16.889872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:16.890473 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:16.896971 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:16.897417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:16.898210 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:16.898640 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:16.989104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f6c218b0-12db-4ec1-ad18-2976337118a1 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.787464 May 26 21:37:16.989953 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 554/1063] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:37:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:37:16.999648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2465c358-ae42-4347-b16f-ab17e09fe605 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:17.000546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2465c358-ae42-4347-b16f-ab17e09fe605 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:17.049357 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:17.059585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:17.062301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:17.064136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-023aa12e-d2a0-4cd2-82ee-b2758e4cbfa9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1745 microversion: 2.20 time: 0.178538 May 26 21:37:17.066035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 510/1064] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:16 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:17.067945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2465c358-ae42-4347-b16f-ab17e09fe605 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:17.076113 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2465c358-ae42-4347-b16f-ab17e09fe605 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1241 microversion: 2.1 time: 0.080183 May 26 21:37:17.076830 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 555/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:16 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:37:18.102513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:18.103105 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:18.107262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:18.111574 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:18.112326 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:18.113335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:18.113767 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:18.128316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:18.147623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:18.149481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:18.150504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:18.150943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:18.247224 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:18.258053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e71e017e-7811-47c8-956d-23cc274f547d tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1245 microversion: 2.1 time: 0.157666 May 26 21:37:18.261835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 556/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:18 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1245 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:18.313462 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:18.322519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:18.324511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:18.325841 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9e8c3f74-d179-4d93-b0ab-8904003c527b tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.242398 May 26 21:37:18.326870 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 511/1067] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:18 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:19.275303 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:19.276839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:19.284835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:19.285661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:19.286706 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:19.287378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:19.345560 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:19.346856 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:19.362446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:19.366394 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:19.367451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:19.368155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:19.392306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:19.401749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-06a396a4-8b76-4871-bc3c-6e12c731afc7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1301 microversion: 2.1 time: 0.131039 May 26 21:37:19.409670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 557/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:19 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:19.615996 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:19.628637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:19.630477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:19.632171 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-71f34b33-7867-4e50-b351-087d25332a31 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.290959 May 26 21:37:19.633505 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 512/1069] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:19 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:20.422314 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:20.423094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:20.437613 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:20.440709 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:20.441813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:20.442278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:20.611529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:20.621873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8a531711-fa00-477a-a7e1-f6c26c3f1771 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.203321 May 26 21:37:20.622654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 558/1070] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:20 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:20.652808 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:20.653526 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:20.661660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:20.662213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:20.663240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:20.664033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:20.945312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:20.945312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:20.945644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:20.945644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1b3809fc-731a-4fb3-9359-ed69823a5b56 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.288539 May 26 21:37:20.945644 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 513/1071] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:20 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:21.640993 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:21.645018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:21.662543 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:21.664623 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:21.665968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:21.673034 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:21.676822 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-03c6c6e4-b515-4bf9-a817-e6d957aa46d2 req-39311d81-52ce-4f4d-8107-7a2df2a84701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9330f59f-5bf2-4fa6-a660-052cde3c4356", "tag": "c5e60f5a-5490-4fca-a70a-4cc7266c0f9e"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:21.692450 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-03c6c6e4-b515-4bf9-a817-e6d957aa46d2 req-39311d81-52ce-4f4d-8107-7a2df2a84701 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:21.695600 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-03c6c6e4-b515-4bf9-a817-e6d957aa46d2 req-39311d81-52ce-4f4d-8107-7a2df2a84701 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:21.716451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-03c6c6e4-b515-4bf9-a817-e6d957aa46d2 req-39311d81-52ce-4f4d-8107-7a2df2a84701 service nova] Creating event network-changed:c5e60f5a-5490-4fca-a70a-4cc7266c0f9e for instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 on hv-cinder-82880 May 26 21:37:21.728349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-03c6c6e4-b515-4bf9-a817-e6d957aa46d2 req-39311d81-52ce-4f4d-8107-7a2df2a84701 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055619 May 26 21:37:21.729010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 514/1072] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:37:21.923147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:21.932478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-143d06a3-a2e7-44a5-b01a-ce9c322bd86f tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.296625 May 26 21:37:21.942273 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 559/1073] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:21 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:21.966475 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:21.967298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:21.974131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:21.974898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:21.976310 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:21.977434 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:22.208323 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:22.221030 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:22.222708 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:22.224044 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f19ea198-bb58-4ceb-b4d9-b9d5bf5a37a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.262875 May 26 21:37:22.225653 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 515/1074] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:21 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:22.949872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:22.951302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:22.958978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:22.959716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:22.960837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:22.961454 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:23.116002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:23.128260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-48614868-0c72-4540-a847-cefab1922b2b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.182269 May 26 21:37:23.128849 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 560/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:22 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:23.242690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:23.243384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:23.251008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:23.251658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:23.252532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:23.253193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:23.412853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:23.423373 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:23.425206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:23.426395 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-39017ee5-ea0b-4e2e-89cf-b5f9613457ad tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.187929 May 26 21:37:23.427185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 516/1076] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:23 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:24.146235 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:24.146893 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:24.149917 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:24.155855 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:24.156535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:24.157203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:24.157746 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:24.302308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:24.310760 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-42046c09-96fd-4464-877b-077f223b9d46 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.168420 May 26 21:37:24.311398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 561/1077] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:24 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:37:24.444826 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:24.445522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:24.447879 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:24.452897 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:24.453418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:24.454198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:24.454639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:24.586134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:24.594441 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:24.595965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:24.597257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1ad944bf-ae95-4241-a2d0-0c032a49da18 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.156396 May 26 21:37:24.597819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 517/1078] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:24 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:25.329225 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:25.329776 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:25.337300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:25.337856 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:25.339000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:25.339445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:25.481635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:25.489068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5e31950a-177b-4b94-8478-c47a958ca1e9 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.164224 May 26 21:37:25.489629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 562/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:25 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:25.621536 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:25.622992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:25.630309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:25.631069 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:25.632238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:25.632472 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:25.800904 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:25.811101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:25.812725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:25.813904 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dd99d720-aa53-4cd4-a5b6-897d190177cc tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.197355 May 26 21:37:25.814658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 518/1080] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:25 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:26.505297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:26.507054 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:26.514507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:26.515061 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:26.515966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:26.516539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:26.687653 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:26.701324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-95ac5669-6722-470c-b3d0-34d35967f3bf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.199703 May 26 21:37:26.706254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 563/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:26 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:26.833205 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:26.833881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:26.841132 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:26.841587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:26.842363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:26.842785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:27.008047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:27.018400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:27.020265 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:27.021535 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d830e72e-2469-4803-b0ed-70991bb022ed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.192617 May 26 21:37:27.022297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 519/1082] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:26 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:27.718059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:27.718675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:27.720657 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:27.721211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=12 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:27.726491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:27.726939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:27.727708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:27.728381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:27.859350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:27.868648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fffdb105-be2a-4819-ace6-2175bc0aa715 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.154413 May 26 21:37:27.875316 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 564/1083] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:27 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:28.045616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:28.053682 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:28.065929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:28.066376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:28.067074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:28.067512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:28.252251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:28.274069 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:28.276008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:28.277309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-36d3933d-1893-46b9-be0c-b691efa969c7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.241965 May 26 21:37:28.286882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 520/1084] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:28 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:28.886148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:28.887280 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:28.894892 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:28.895351 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:28.896185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:28.896591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:29.032791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:29.040333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-382aed7e-598f-4b91-a93b-36d5a171cd37 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.158054 May 26 21:37:29.040961 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 565/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:28 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:29.305616 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:29.306171 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:29.313277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:29.313730 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:29.314501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:29.314940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:29.451375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:29.460631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:29.462187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:29.463365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8a3192c0-dc95-4a77-b9c6-5fe2f95f7ab6 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1740 microversion: 2.20 time: 0.161787 May 26 21:37:29.463970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 521/1086] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:29 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:29.831996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-ae5ee852-69b0-417a-8d7c-ce0dd53f71ae req-eba2e259-4a2a-406c-86c5-0be7068d3f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9330f59f-5bf2-4fa6-a660-052cde3c4356", "name": "network-vif-plugged", "status": "completed", "tag": "c5e60f5a-5490-4fca-a70a-4cc7266c0f9e"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:29.840379 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-ae5ee852-69b0-417a-8d7c-ce0dd53f71ae req-eba2e259-4a2a-406c-86c5-0be7068d3f56 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:29.840817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-ae5ee852-69b0-417a-8d7c-ce0dd53f71ae req-eba2e259-4a2a-406c-86c5-0be7068d3f56 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:29.852114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-ae5ee852-69b0-417a-8d7c-ce0dd53f71ae req-eba2e259-4a2a-406c-86c5-0be7068d3f56 service nova] Creating event network-vif-plugged:c5e60f5a-5490-4fca-a70a-4cc7266c0f9e for instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 on hv-cinder-82880 May 26 21:37:29.857920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-ae5ee852-69b0-417a-8d7c-ce0dd53f71ae req-eba2e259-4a2a-406c-86c5-0be7068d3f56 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029672 May 26 21:37:29.860826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 566/1087] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:37:30.057817 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:30.058431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:30.064674 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:30.065127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:30.065903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:30.066351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:30.084756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:30.218958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:30.226632 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-217b2a0b-f093-4b02-8bdb-e0d389f21855 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.172744 May 26 21:37:30.230095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 522/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:30 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:30.482403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:30.483192 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:30.489505 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:30.489954 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:30.490725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:30.491165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:30.624278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:30.632331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:30.633857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:30.635010 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cc9ab24b-50a0-4ea6-8211-6d6e3a7b8aed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1722 microversion: 2.20 time: 0.157401 May 26 21:37:30.635571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 567/1089] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:30 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:31.244610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:31.245214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:31.251769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:31.252230 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:31.252991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:31.253420 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:31.387171 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:31.394537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-266e2eb3-7325-4ae0-9588-94e9fb8bedaa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.154251 May 26 21:37:31.395097 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 523/1090] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:31 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:31.653806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:31.654349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:31.661001 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:31.661467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:31.662228 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:31.662670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:31.790249 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:31.799008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:31.800558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:31.801696 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1072e737-1477-4b88-865b-b28ee3526e4f tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1722 microversion: 2.20 time: 0.151976 May 26 21:37:31.802250 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 568/1091] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:31 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:32.411706 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:32.412343 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:32.419639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:32.420119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:32.421215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:32.421654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:32.550820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:32.558356 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2c60ed50-f290-44bf-a80a-19983b8b79c8 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.150593 May 26 21:37:32.558920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 524/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:32 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:32.820372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:32.820991 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:32.828197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:32.828645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:32.829406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:32.829836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:32.964231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:32.965938 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:32.967458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:32.968650 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-af6a2389-6758-4b9e-8a5e-a34989d3006e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1722 microversion: 2.20 time: 0.152208 May 26 21:37:32.969214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 569/1093] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:32 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:33.574455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:33.575077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:33.581725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:33.582172 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:33.582940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:33.583376 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:33.715349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:33.722777 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e32d7d31-ee36-43de-a90f-a38a78428687 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.152271 May 26 21:37:33.723326 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 525/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:33 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:33.987283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:33.987991 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:33.994715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:33.995396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:33.996377 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:33.997024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:34.000202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-f0d45a7f-8e6d-4ddc-a4c1-9a4421ea1fc0 req-852a3904-7ef0-469a-9b45-ed4a3b15f2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "name": "network-vif-unplugged", "status": "completed", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:34.009492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f0d45a7f-8e6d-4ddc-a4c1-9a4421ea1fc0 req-852a3904-7ef0-469a-9b45-ed4a3b15f2fb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:34.009964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-f0d45a7f-8e6d-4ddc-a4c1-9a4421ea1fc0 req-852a3904-7ef0-469a-9b45-ed4a3b15f2fb service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:34.021950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-f0d45a7f-8e6d-4ddc-a4c1-9a4421ea1fc0 req-852a3904-7ef0-469a-9b45-ed4a3b15f2fb service nova] Creating event network-vif-unplugged:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:37:34.027532 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-f0d45a7f-8e6d-4ddc-a4c1-9a4421ea1fc0 req-852a3904-7ef0-469a-9b45-ed4a3b15f2fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030776 May 26 21:37:34.028159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 526/1095] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:37:34.132969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:34.141839 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:34.143367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:34.144600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0d6e24ef-44e5-4e19-976c-f119ca1ad1aa tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1722 microversion: 2.20 time: 0.161501 May 26 21:37:34.145165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 570/1096] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:33 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:34.741609 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:34.742316 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:34.749432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:34.749882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:34.750652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:34.751096 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:34.885438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:34.893049 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-07610fe4-874f-41cd-8a15-9ddff8ae8a3c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.156273 May 26 21:37:34.893816 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 527/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:34 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:35.164321 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:35.164999 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:35.172093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:35.172551 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:35.173327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:35.173857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:35.302745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:35.310857 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:35.312419 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:35.313567 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-be5ec92f-2b23-46ee-9ebf-e8ce7e58c711 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1722 microversion: 2.20 time: 0.154316 May 26 21:37:35.314130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 571/1098] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:35 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:35.909858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:35.910478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:35.917022 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:35.918136 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:35.918915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:35.919361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:36.046877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:36.054333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-04b412a0-9acb-410b-b9bd-d53f696ad4d6 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.148398 May 26 21:37:36.054988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 528/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:35 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:36.331037 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:36.331579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:36.338385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:36.338831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:36.340283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:36.340716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:36.373100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:36.486001 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:36.494500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:36.496155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:36.497311 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e686373c-c221-4124-b762-de878b36e8b1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1722 microversion: 2.20 time: 0.170378 May 26 21:37:36.497872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 572/1100] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:36 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:37.070421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:37.071010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:37.077481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:37.077924 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:37.078680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:37.079109 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:37.205729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:37.214272 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2ea55ff7-0aa1-4667-bf86-8176a97a9174 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1366 microversion: 2.1 time: 0.147671 May 26 21:37:37.214847 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 529/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:37 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:37.515951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:37.517209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:37.523455 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:37.525030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:37.525030 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:37.525234 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:37.659104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:37.670093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:37.672528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:37.673725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-037a7911-a741-49de-9e1a-f5e31e3946f8 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1725 microversion: 2.20 time: 0.162012 May 26 21:37:37.674292 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 573/1102] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:37 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:37.694891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d2e56d7-2f8f-4797-b842-465b6da4ccd4"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:37.696203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:37.702733 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:37.703267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:37.704148 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:37.704653 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:38.230390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:38.231259 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:38.237199 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:38.237589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:38.238360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:38.238797 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:38.367039 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:38.375320 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a5c44772-efba-4690-9fd1-4d68f49ee5aa tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1555 microversion: 2.1 time: 0.148798 May 26 21:37:38.375905 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 574/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:38 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:37:38.391963 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:38.392458 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:38.398371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:38.398820 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:38.399581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:38.400938 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:38.484515 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6432077c-9a81-4a40-a964-e5d280b8e058 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096239 May 26 21:37:38.485512 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 575/1104] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:37:38 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:37:38.771381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8d08552e-17b1-42bf-a7cb-f779e10ac580 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.080570 May 26 21:37:38.772117 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 530/1105] 10.222.0.42 () {62 vars in 1363 bytes} [Thu May 26 21:37:37 2022] POST /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-volume_attachments => generated 188 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:37:38.890041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:38.890636 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:38.896701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:38.897149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:38.897926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:38.898362 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:39.524446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-531e1f03-2aa3-4800-bd57-16d7d583e1f9 req-4114973a-eb94-498d-a901-421ae21c2a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9330f59f-5bf2-4fa6-a660-052cde3c4356", "tag": "c5e60f5a-5490-4fca-a70a-4cc7266c0f9e"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:39.534871 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-531e1f03-2aa3-4800-bd57-16d7d583e1f9 req-4114973a-eb94-498d-a901-421ae21c2a9a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:39.535318 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-531e1f03-2aa3-4800-bd57-16d7d583e1f9 req-4114973a-eb94-498d-a901-421ae21c2a9a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:39.548528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-531e1f03-2aa3-4800-bd57-16d7d583e1f9 req-4114973a-eb94-498d-a901-421ae21c2a9a service nova] Creating event network-changed:c5e60f5a-5490-4fca-a70a-4cc7266c0f9e for instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 on hv-cinder-82880 May 26 21:37:39.555046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-531e1f03-2aa3-4800-bd57-16d7d583e1f9 req-4114973a-eb94-498d-a901-421ae21c2a9a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095730 May 26 21:37:39.555852 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 531/1106] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:37:39.595033 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-833fc343-1ed9-426c-ab95-a3bc562e4ade tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-volume_attachments/8d2e56d7-2f8f-4797-b842-465b6da4ccd4" status: 202 len: 0 microversion: 2.20 time: 0.709302 May 26 21:37:39.595991 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 576/1107] 10.222.0.42 () {60 vars in 1456 bytes} [Thu May 26 21:37:38 2022] DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-volume_attachments/8d2e56d7-2f8f-4797-b842-465b6da4ccd4 => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:37:39.667597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:39.668284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:39.675405 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:39.675911 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:39.676691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:39.677134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:39.913829 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d399de87-8c2f-4f41-970b-3c7581c9d211 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "POST /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/action" status: 202 len: 0 microversion: 2.20 time: 0.250448 May 26 21:37:39.914999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 532/1108] 10.222.0.42 () {62 vars in 1318 bytes} [Thu May 26 21:37:39 2022] POST /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:37:39.924733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:39.929565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:39.943511 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:39.944135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:39.945032 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:39.945579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:40.158242 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:40.166848 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:40.175933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:40.175933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ad7e2e2f-0113-4dc2-8db7-ad6cbfa753f7 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1673 microversion: 2.20 time: 0.251126 May 26 21:37:40.175933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 577/1109] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:39 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:40.587803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1312790067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-80832212", "security_groups": [{"name": "tempest-secgroup-smoke-389140089"}], "block_device_mapping_v2": [{"uuid": "5de99808-8b73-486b-87ba-40f1b8905da1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e9f896ed-3367-41b4-ace5-9c753fe1f6ff"}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:37:40.710158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] validate_networks() for [('e9f896ed-3367-41b4-ace5-9c753fe1f6ff', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:37:41.142894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:37:41.143483 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:37:41.143841 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:37:41.144254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:37:41.144667 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:37:41.153739 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:41.154185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:41.154981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:41.155449 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:41.172765 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:37:41.176985 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Getting quotas for user 88575c0bd9db4fa8bc9bd511c0ac37dd and project 87d8cb3f18ae4f05a85dc21abaf316cb. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:37:41.189534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:41.190211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:41.197496 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:41.197950 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:41.199392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:41.199863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:41.239121 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:37:41.241233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5de99808-8b73-486b-87ba-40f1b8905da1',volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:37:41.336860 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:41.344904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:41.346478 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:41.347566 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d71114e1-9198-48bd-a03b-316a20b6c6e1 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1673 microversion: 2.20 time: 0.162006 May 26 21:37:41.348166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 578/1110] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:41 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:41.690142 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b840610d-4140-45ed-9aa0-53e719cf1c75 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.107221 May 26 21:37:41.690790 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 533/1111] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:37:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:37:41.701331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2f187fac-79e1-43b4-9d1f-a45f667ddb25 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:41.701946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2f187fac-79e1-43b4-9d1f-a45f667ddb25 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:41.758426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2f187fac-79e1-43b4-9d1f-a45f667ddb25 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:41.765872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2f187fac-79e1-43b4-9d1f-a45f667ddb25 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1093 microversion: 2.1 time: 0.068925 May 26 21:37:41.766462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 579/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:41 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:42.369553 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:42.370235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:42.377772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:42.378184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:42.379315 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:42.379794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:42.533240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:42.541497 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:42.543601 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:42.544793 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ba04156c-f365-4a82-9d54-3a7367f6366c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.179389 May 26 21:37:42.545618 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 534/1113] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:42 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:42.783041 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:42.783661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:42.795636 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:42.796111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:42.796900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:42.797349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:42.860057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:42.867852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e1d5a3b1-d51a-49bc-8d83-b770b4852395 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1143 microversion: 2.1 time: 0.088737 May 26 21:37:42.868517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 580/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:42 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:43.565648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:43.567086 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:43.576824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:43.577647 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:43.578776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:43.579387 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:43.729271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:43.738070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:43.739593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:43.740783 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d1cc099c-7268-4add-a055-d983c082425a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.180867 May 26 21:37:43.741347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 535/1115] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:43 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:43.885695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:43.886251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:43.898219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:43.898666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:43.899445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:43.899910 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:43.965638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:43.973783 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0124442e-5f5a-4ba4-bcce-617c8f7699f9 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.092114 May 26 21:37:43.974882 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 581/1116] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:43 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:44.758788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:44.759420 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:44.766788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:44.767240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:44.768046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:44.768486 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:44.909677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:44.917839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:44.919326 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:44.920777 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-67b47ad5-6b34-4b62-8c45-8a31da0e2314 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.165686 May 26 21:37:44.921424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 536/1117] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:44 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:44.994608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:44.995863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:45.003414 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:45.003898 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:45.004689 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:45.005124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:45.071480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:45.080487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1559934a-3556-466d-b971-73c0fea92ac2 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.091709 May 26 21:37:45.090538 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 582/1118] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:44 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:45.938481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:45.939089 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:45.945680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:45.946129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:45.946902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:45.947341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:45.966678 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:46.098497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:46.099005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:46.100875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:46.108365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:46.109479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:46.109887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:46.110355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:46.111152 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-13b98801-9def-4e9c-a333-696872942fed tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.176622 May 26 21:37:46.111293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:46.111715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 537/1119] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:45 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:46.111933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:46.173566 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:46.181036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-32deaf49-beca-46a5-ba78-7cae864fdf82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.086562 May 26 21:37:46.181615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 583/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:46 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:47.129255 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:47.129863 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:47.136471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:47.136920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:47.137722 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:47.138167 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:47.197889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:47.198705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:47.205686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:47.206403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:47.207181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:47.207619 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:47.289198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:47.299907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:47.301221 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:47.308565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dbe9c2d9-0609-47a7-bfe5-6aceabdd9b38 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.114469 May 26 21:37:47.309539 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 584/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:47 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:37:47.311223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:47.312967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cfeb83f7-bda4-46c9-a533-965cdfd385a4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.187642 May 26 21:37:47.313780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 538/1122] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:47 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:48.325694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:48.326265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:48.330185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:48.330786 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:48.332588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:48.333040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:48.333813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:48.334254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:48.336741 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:48.337194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:48.337953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:48.338389 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:48.401040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:48.409387 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-93aa3411-696a-4db4-95a7-bbcc949c3295 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.087606 May 26 21:37:48.410302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 585/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:48 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:48.492223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:48.500946 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:48.502540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:48.503717 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-7325f7d5-bdab-40c2-8389-358f81aa3367 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.177473 May 26 21:37:48.504308 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 539/1124] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:48 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:49.428448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:49.429057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:49.436230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:49.436677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:49.437504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:49.437941 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:49.506080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:49.514372 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-87619357-5a54-4aa7-b304-c501b4a26728 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.089863 May 26 21:37:49.514943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 586/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:49 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:49.521749 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:49.522353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:49.529601 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:49.530048 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:49.530816 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:49.531251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:49.689813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:49.698197 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:49.700426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:49.701597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4202e549-5a82-4509-8ede-40e9157b2a00 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.183733 May 26 21:37:49.702346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 540/1126] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:49 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:50.532300 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:50.532853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:50.539733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:50.540206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:50.540991 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:50.541430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:50.624694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:50.637055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-641aa57e-f0b4-4683-86f1-13dccb59982a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.108615 May 26 21:37:50.637788 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 587/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:50 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:50.720584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:50.721193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:50.727859 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:50.728319 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:50.729092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:50.729534 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:50.857241 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:50.865757 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:50.871784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:50.871784 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a9effada-fc54-46d3-b9d7-0a0e97e97d6d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.152291 May 26 21:37:50.881157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 541/1128] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:50 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:51.654719 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:51.655318 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:51.662133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:51.663888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:51.663888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:51.663888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:51.666850 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:51.732772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:51.740393 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6bcebc79-6aa4-4cc2-8822-4de347921360 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.090008 May 26 21:37:51.740979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 588/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:51 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:51.888483 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:51.889268 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:51.895175 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:51.895928 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:51.898188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:51.898650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:51.899457 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:51.899914 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:52.047311 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:52.057096 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:52.058669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:52.059919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a01632cc-a864-4dc4-9f4c-70dcf7fb64ca tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.175452 May 26 21:37:52.060476 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 542/1130] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:51 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:52.757537 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:52.758232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:52.769658 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:52.777773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:52.778165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:52.779123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:52.779568 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:52.856550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:52.864040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a02a2772-15ed-4e23-b31e-c096b9fb3500 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.110412 May 26 21:37:52.864610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 589/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:52 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:53.079038 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:53.079696 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:53.091168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:53.092031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:53.093068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:53.093845 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:53.242102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:53.257074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:53.259237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:53.260907 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d464b997-4d72-49ef-95f5-7d44baa26f0c tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.186606 May 26 21:37:53.267820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 543/1132] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:53 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:37:53.881351 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:53.881956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:53.888876 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:53.889330 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:53.890092 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:53.890528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:53.955685 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:53.963038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1c8e5dbb-287b-4cb9-9d57-26d33388387f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.085603 May 26 21:37:53.963606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 590/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:53 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:54.279858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:54.280395 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:54.287522 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:54.288036 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:54.288919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:54.289364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:54.419161 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:54.427436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:54.429150 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:54.430363 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-540bee95-840f-47f0-8cc0-78db0c19a5da tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.155367 May 26 21:37:54.430880 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 544/1134] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:54 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:54.981442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:54.987726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:54.989103 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:54.989558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:54.990327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:54.990768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:55.294713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:55.302525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ccd68cbf-179c-46c3-a7a4-f0d7d3533ce6 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.325914 May 26 21:37:55.303119 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 591/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:54 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:55.448447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:55.449074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:55.455648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:55.456128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:55.456898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:55.457332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:55.585901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:55.594505 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:55.596045 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:55.597211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b6f33197-8f2f-4d58-a827-9b1ab1b12ed2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.152730 May 26 21:37:55.597777 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 545/1136] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:55 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:56.319296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:56.319940 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:56.322357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=64 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:56.327172 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:56.327624 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:56.328421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:56.328858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:56.389486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:56.397007 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-902c8a21-9a71-44df-80fd-70dfe81d6bad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.081573 May 26 21:37:56.397572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 592/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:56 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:56.616571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:56.617133 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:56.619411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:56.624301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:56.624752 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:56.625520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:56.625957 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:56.754971 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:56.763866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:56.765364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:56.766524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-917b6fce-ed50-4fb9-869a-c3b79a26f239 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.154079 May 26 21:37:56.767209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 546/1138] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:56 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:57.415022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:57.415610 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:57.422899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:57.423345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:57.424131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:57.424564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:57.486758 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:57.494430 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8da7af59-cfe5-4f5a-88cc-c8a5eed42930 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.083556 May 26 21:37:57.495851 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 593/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:57 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:57.785194 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:57.785802 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:57.793113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:57.793564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:57.794332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:57.794773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:57.926598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:57.934692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:57.936254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:57.937412 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-acfb1fc3-d531-4d0f-8fa9-871b6a03724e tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.156293 May 26 21:37:57.937968 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 547/1140] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:57 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:58.512720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:58.513305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:58.522914 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:58.523720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:58.525146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:58.525978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:58.589425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:58.596908 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a9567309-a1dd-4c34-88d1-af1179dc5453 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1191 microversion: 2.1 time: 0.088650 May 26 21:37:58.597480 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 594/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:58 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:37:58.954861 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:58.962770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:58.962770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:58.962770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:58.963084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:58.963515 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:59.091426 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:59.099329 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:59.100910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:59.102085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-95eefd7e-30ea-41d4-8c56-3ce080c006af tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.151114 May 26 21:37:59.102648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 548/1142] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:37:58 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:37:59.614503 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:37:59.617834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:37:59.623112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:59.623557 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:59.624357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:37:59.624792 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:37:59.692310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:37:59.700708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-82bb51b7-5ccc-4d5c-8258-ea3a6cf00c1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1209 microversion: 2.1 time: 0.090705 May 26 21:37:59.701323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 595/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:37:59 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:00.125882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:00.128083 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:00.132851 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:00.133333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:00.134108 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:00.134545 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:00.370580 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:00.378661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:00.380222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:00.381427 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f0a4e28c-cfec-4d85-8068-385c1f859d90 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.265102 May 26 21:38:00.381991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 549/1144] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:00 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:00.723707 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:00.724975 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:00.732575 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:00.733180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:00.734227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:00.734853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:00.869156 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:00.876841 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-eee9c683-dc19-4cd8-b6c9-7fee81e987ff tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1276 microversion: 2.1 time: 0.157396 May 26 21:38:00.877417 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 596/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:00 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:01.331533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-8b84ddba-5286-4d3c-a907-11900b820a62 req-272f26a1-8800-4c20-8603-48cbc4a32c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb2a3109-7643-4486-9b81-c1ab0c30d882", "tag": "fcb1b6ae-a8e4-40da-a068-0102dba09fcf"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:01.343732 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-8b84ddba-5286-4d3c-a907-11900b820a62 req-272f26a1-8800-4c20-8603-48cbc4a32c16 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:01.345259 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-8b84ddba-5286-4d3c-a907-11900b820a62 req-272f26a1-8800-4c20-8603-48cbc4a32c16 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:01.358525 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-8b84ddba-5286-4d3c-a907-11900b820a62 req-272f26a1-8800-4c20-8603-48cbc4a32c16 service nova] Creating event network-changed:fcb1b6ae-a8e4-40da-a068-0102dba09fcf for instance fb2a3109-7643-4486-9b81-c1ab0c30d882 on hv-cinder-82880 May 26 21:38:01.364645 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-8b84ddba-5286-4d3c-a907-11900b820a62 req-272f26a1-8800-4c20-8603-48cbc4a32c16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036327 May 26 21:38:01.366335 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 550/1146] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:01.401828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:01.401828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:01.407445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:01.408044 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:01.409038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:01.409547 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:01.555326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:01.564403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:01.565946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:01.567136 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-60ccc533-c5f7-48c8-b44a-6e2b2f07330a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.171745 May 26 21:38:01.567700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 597/1147] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:01 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:01.894014 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:01.894712 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:01.901749 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:01.902199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:01.903029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:01.903466 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:02.123047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:02.133502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-152f42c3-a8f3-4866-af85-97d109af8a5c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.243553 May 26 21:38:02.134768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 551/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:01 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:02.195814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-d7a80029-73c0-49b1-bb92-bc7105978a30 req-1d269730-1a5c-4fa7-b3d4-30f1d4e38dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "name": "network-vif-plugged", "status": "completed", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:02.205598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-d7a80029-73c0-49b1-bb92-bc7105978a30 req-1d269730-1a5c-4fa7-b3d4-30f1d4e38dbc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:02.206115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-d7a80029-73c0-49b1-bb92-bc7105978a30 req-1d269730-1a5c-4fa7-b3d4-30f1d4e38dbc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:02.218324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-d7a80029-73c0-49b1-bb92-bc7105978a30 req-1d269730-1a5c-4fa7-b3d4-30f1d4e38dbc service nova] Creating event network-vif-plugged:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:38:02.223607 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-d7a80029-73c0-49b1-bb92-bc7105978a30 req-1d269730-1a5c-4fa7-b3d4-30f1d4e38dbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031508 May 26 21:38:02.224304 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 598/1149] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:02.585888 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:02.586589 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:02.593806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:02.594254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:02.595023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:02.595461 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:02.732500 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:02.740386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:02.741903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:02.743054 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b8dd6a08-dd6f-41ef-8420-861a905146ef tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.161183 May 26 21:38:02.743617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 552/1150] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:02 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:03.151612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:03.152367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:03.159519 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:03.160014 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:03.160779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:03.161217 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:03.296106 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:03.303629 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d48f797e-b75b-43ad-8117-accda34f32fa tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.156726 May 26 21:38:03.304221 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 599/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:03 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:03.761611 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:03.762215 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:03.768782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:03.769227 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:03.769987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:03.770418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:03.901693 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:03.909794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:03.911311 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:03.915075 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ab32ab5d-a377-4b98-858e-fc5c495c5055 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.155447 May 26 21:38:03.915075 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 553/1152] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:03 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:04.320281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:04.320989 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:04.327686 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:04.328206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:04.330729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:04.331177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:04.468742 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:04.476408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ba5b8bb2-01a6-48a8-9155-c01a63f14d29 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.160030 May 26 21:38:04.476984 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 600/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:04 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:04.930746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:04.931351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:04.937893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:04.938346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:04.939115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:04.939552 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:05.071231 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:05.074791 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=100 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:05.079692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:05.081380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:05.082472 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-83245674-d8ca-4baa-8074-1919283d0188 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.155681 May 26 21:38:05.083041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 554/1154] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:04 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:05.494391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:05.495000 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:05.501545 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:05.501992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:05.502756 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:05.503194 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:05.635385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:05.643412 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-65d0b607-e5e1-4353-8c38-9c7fd692c158 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.152928 May 26 21:38:05.644017 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 601/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:05 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:06.101292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:06.101933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:06.108780 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:06.109229 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:06.109988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:06.110436 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:06.242040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:06.251028 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:06.252576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:06.253732 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b97eb292-f194-4a49-8b8b-aae438714dab tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1731 microversion: 2.20 time: 0.156892 May 26 21:38:06.254289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 555/1156] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:06 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:06.660848 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:06.661591 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:06.669099 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:06.674880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:06.674880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:06.674880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:06.814983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:06.822896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-97e22cb7-babb-47e3-98ed-ba8a300a8e90 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.165819 May 26 21:38:06.823475 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 602/1157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:06 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:07.271990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:07.272595 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:07.279790 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.280242 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.281007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.281442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.412069 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:07.420860 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:07.422435 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:07.423629 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c8bc5d4b-e038-4bd9-a338-82e20df72561 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1718 microversion: 2.20 time: 0.155699 May 26 21:38:07.424220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 556/1158] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:38:07 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:07.840326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:07.840935 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:07.847476 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.847959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.848726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.849171 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.980429 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:07.988080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0a1fb111-271c-4dd2-afc3-cbd75ea53311 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.152232 May 26 21:38:07.988654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 603/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:07 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:09.005220 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:09.005844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:09.012482 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:09.012932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:09.013732 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:09.014189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:09.143077 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:09.151992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5b87f13d-d085-4281-9cce-31f307b63633 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.150000 May 26 21:38:09.152862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 557/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:09 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:10.170185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:10.170717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:10.177293 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:10.177737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:10.178496 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:10.178929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:10.308846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:10.316345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-504ec8f6-d397-4f5c-b99a-18fbe4a1b0f0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.150445 May 26 21:38:10.316920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 604/1161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:10 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:11.333976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:11.334663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:11.341670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:11.342111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:11.342871 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:11.343304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:11.477050 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:11.484637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d0c1a4a5-2afe-4ab3-9aa3-1ce4500f0e82 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.154640 May 26 21:38:11.485213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 558/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:11 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:12.502400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:12.503013 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:12.509803 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:12.510238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:12.511011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:12.511455 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:12.526577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=100 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:12.643327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:12.650772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a9171f9c-12b6-417e-976f-cff9994aba3f tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.152397 May 26 21:38:12.651333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 605/1163] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:12 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:13.667844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:13.668449 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:13.675300 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:13.675762 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:13.676537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:13.676967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:13.806751 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:13.814982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b1f2d700-c7f9-4fe6-a927-417950f9ca95 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.151084 May 26 21:38:13.815543 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 559/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:13 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:14.387708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-95f866b3-19e4-41e5-a38a-eb5559acbe24 req-49b0ee73-1ea9-46c9-8bb7-75be94fd2a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb2a3109-7643-4486-9b81-c1ab0c30d882", "name": "network-vif-plugged", "status": "completed", "tag": "fcb1b6ae-a8e4-40da-a068-0102dba09fcf"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:14.395877 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-95f866b3-19e4-41e5-a38a-eb5559acbe24 req-49b0ee73-1ea9-46c9-8bb7-75be94fd2a15 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:14.396333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-95f866b3-19e4-41e5-a38a-eb5559acbe24 req-49b0ee73-1ea9-46c9-8bb7-75be94fd2a15 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:14.407842 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-95f866b3-19e4-41e5-a38a-eb5559acbe24 req-49b0ee73-1ea9-46c9-8bb7-75be94fd2a15 service nova] Creating event network-vif-plugged:fcb1b6ae-a8e4-40da-a068-0102dba09fcf for instance fb2a3109-7643-4486-9b81-c1ab0c30d882 on hv-cinder-82880 May 26 21:38:14.412823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-95f866b3-19e4-41e5-a38a-eb5559acbe24 req-49b0ee73-1ea9-46c9-8bb7-75be94fd2a15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082906 May 26 21:38:14.413472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 606/1165] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:14.831887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:14.832501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:14.838962 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:14.839393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:14.840747 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:14.841189 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:14.968487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:14.975939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-92e8ba3a-af57-4c6d-bfa2-0f7a6cbb49c0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.147913 May 26 21:38:14.976520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 560/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:14 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:15.994482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:15.995198 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:16.002268 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:16.002725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:16.003479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:16.003954 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:16.139093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:16.146598 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-01f212b2-8d5e-4d67-bc74-5a76be04e127 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1264 microversion: 2.1 time: 0.157025 May 26 21:38:16.147170 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 607/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:15 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:17.163559 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:17.164193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:17.171072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:17.171520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:17.172324 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:17.172759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:17.303361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:17.311596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-090edd0b-7779-46cd-bab7-76f7e9c5be13 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1451 microversion: 2.1 time: 0.151811 May 26 21:38:17.312196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 561/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:17 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:17.328214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:17.328850 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:17.335391 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:17.335867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:17.336656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:17.337621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:17.464481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:17.472027 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6bd72845-e696-4d9e-9a6c-512a104b3498 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1451 microversion: 2.1 time: 0.148327 May 26 21:38:17.472592 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 608/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:17 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:19.485510 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-a77834a5-2d3f-4707-ba53-e1f828e8593c req-27cf64c2-ec2e-4f3b-bf63-d036d11e8ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb2a3109-7643-4486-9b81-c1ab0c30d882", "tag": "fcb1b6ae-a8e4-40da-a068-0102dba09fcf"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:19.493899 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-a77834a5-2d3f-4707-ba53-e1f828e8593c req-27cf64c2-ec2e-4f3b-bf63-d036d11e8ea0 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:19.494347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-a77834a5-2d3f-4707-ba53-e1f828e8593c req-27cf64c2-ec2e-4f3b-bf63-d036d11e8ea0 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:19.505872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-a77834a5-2d3f-4707-ba53-e1f828e8593c req-27cf64c2-ec2e-4f3b-bf63-d036d11e8ea0 service nova] Creating event network-changed:fcb1b6ae-a8e4-40da-a068-0102dba09fcf for instance fb2a3109-7643-4486-9b81-c1ab0c30d882 on hv-cinder-82880 May 26 21:38:19.510898 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-a77834a5-2d3f-4707-ba53-e1f828e8593c req-27cf64c2-ec2e-4f3b-bf63-d036d11e8ea0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029163 May 26 21:38:19.511495 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 562/1170] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:31.713855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=33 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:31.716263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:31.716819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=44 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:31.718998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:31.721799 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-a90889fc-1bcf-4b1b-a7ce-67a2110035c3 req-42ca811a-9424-4b61-8a72-ad6779004f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:31.725508 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=33 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:31.726808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=17 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:31.731511 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-a90889fc-1bcf-4b1b-a7ce-67a2110035c3 req-42ca811a-9424-4b61-8a72-ad6779004f35 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.731919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-a90889fc-1bcf-4b1b-a7ce-67a2110035c3 req-42ca811a-9424-4b61-8a72-ad6779004f35 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.733193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.733656 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.734465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.735141 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.745839 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-a90889fc-1bcf-4b1b-a7ce-67a2110035c3 req-42ca811a-9424-4b61-8a72-ad6779004f35 service nova] Creating event network-changed:5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a for instance 7586f603-aaac-433d-85db-77c2893aa328 on hv-cinder-82880 May 26 21:38:31.755731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-a90889fc-1bcf-4b1b-a7ce-67a2110035c3 req-42ca811a-9424-4b61-8a72-ad6779004f35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039283 May 26 21:38:31.755731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 563/1171] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:31.780835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:32.182864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f7270fcf-5ae4-4dce-b3ce-3dce3db6df4d tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 204 len: 0 microversion: 2.1 time: 0.474908 May 26 21:38:32.183500 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 609/1172] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:38:31 2022] DELETE /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:32.194381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:32.195095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:32.202446 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:32.208664 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:32.208664 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:32.208664 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:32.352518 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:32.361519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3500547a-7fb8-46f6-a01e-a0f94c46fdb9 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.172514 May 26 21:38:32.362120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 564/1173] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:32 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:38:33.379058 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:33.379940 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:33.386563 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:33.387025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:33.387831 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:33.388272 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:33.530435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:33.538593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1152ec3d-971b-4948-a5b7-6ab06bd06bdc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1568 microversion: 2.1 time: 0.163692 May 26 21:38:33.539182 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 610/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:33 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:34.557868 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:34.558491 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:34.565802 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:34.566249 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:34.567018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:34.567453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:34.788871 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:34.797800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-28415f10-b108-41d9-b66a-b2ae2ad8b1cc tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1449 microversion: 2.1 time: 0.243887 May 26 21:38:34.798606 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 565/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:34 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1449 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:35.011549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-17e715ea-420f-4064-9a14-21e109dde943 req-13cebeea-00cc-4cfd-9bf3-12cfa4014199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7586f603-aaac-433d-85db-77c2893aa328", "name": "network-vif-deleted", "tag": "5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:35.020978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-17e715ea-420f-4064-9a14-21e109dde943 req-13cebeea-00cc-4cfd-9bf3-12cfa4014199 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.021427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-17e715ea-420f-4064-9a14-21e109dde943 req-13cebeea-00cc-4cfd-9bf3-12cfa4014199 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.033601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-17e715ea-420f-4064-9a14-21e109dde943 req-13cebeea-00cc-4cfd-9bf3-12cfa4014199 service nova] Creating event network-vif-deleted:5ecc6dfe-8191-45d6-bae8-ba89c8d3d39a for instance 7586f603-aaac-433d-85db-77c2893aa328 on hv-cinder-82880 May 26 21:38:35.038872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-17e715ea-420f-4064-9a14-21e109dde943 req-13cebeea-00cc-4cfd-9bf3-12cfa4014199 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031235 May 26 21:38:35.039482 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 611/1176] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:35.814769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:35.815399 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:35.822188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.822872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.823439 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.823922 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.892187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38166757db224367bb8208f6366a4184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c3cd3a54424befb4b424e6de1f7870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:35.900502 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e5cc4f9d-58ec-4b36-b725-ade2f8ab3419 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 200 len: 1218 microversion: 2.1 time: 0.089652 May 26 21:38:35.901097 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 566/1177] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:35 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:38:36.918290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:36.918995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [instance: 7586f603-aaac-433d-85db-77c2893aa328] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:36.926206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.926666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.927447 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.927925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.941291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] HTTP exception thrown: Instance 7586f603-aaac-433d-85db-77c2893aa328 could not be found. May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Request method failure captured: May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 HTTP/1.1 May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_HC2xv2mb24qoqQIgzD7pE4tPNlMHJiysjt02eKRUwYnGZRaw18VHfZbbuZMbQ8ukjz-sLetKE3x-yGiHtzHPUlOSxO0USIbi4lgBXdAPc3I8tTFjYy6Z4UJ0YkuhMoNyG7pNNFLhqy9jH0Ddi8cESrePExJxAMmrxAqD7F_630wNg May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 77c3cd3a54424befb4b424e6de1f7870 May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-TestShelveInstance-1289386847 May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:38:36.942918 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_77c3cd3a54424befb4b424e6de1f7870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/77c3cd3a54424befb4b424e6de1f7870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77c3cd3a54424befb4b424e6de1f7870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77c3cd3a54424befb4b424e6de1f7870"}]}] May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-TestShelveInstance-1289386847 May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 77c3cd3a54424befb4b424e6de1f7870 May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-TestShelveInstance-1289386847 May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-TestShelveInstance-1289386847-project May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 38166757db224367bb8208f6366a4184 May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-TestShelveInstance-1289386847-project May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 7586f603-aaac-433d-85db-77c2893aa328 could not be found. May 26 21:38:36.944645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '7586f603-aaac-433d-85db-77c2893aa328'} May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7586f603-aaac-433d-85db-77c2893aa328 could not be found. May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:36.945778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7586f603-aaac-433d-85db-77c2893aa328 could not be found. May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7586f603-aaac-433d-85db-77c2893aa328 could not be found. May 26 21:38:36.947360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:38:36.948723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Returning 404 to user: Instance 7586f603-aaac-433d-85db-77c2893aa328 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:36.948723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c4408d28-86b7-4244-b453-4305c17a3c25 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328" status: 404 len: 111 microversion: 2.1 time: 0.030793 May 26 21:38:36.948723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 612/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:38:36 2022] GET /compute/v2.1/servers/7586f603-aaac-433d-85db-77c2893aa328 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:38:37.170690 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c27c9b49-ca5c-45ec-bd34-7195b44925f1 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] Calling method '.version_select at 0x7f7bc4d70430>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:37.174981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c27c9b49-ca5c-45ec-bd34-7195b44925f1 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [ee4ac696-32a1-4a9a-90a3-afe2aadad187] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:38:38.182820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [None req-c27c9b49-ca5c-45ec-bd34-7195b44925f1 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] [ee4ac696-32a1-4a9a-90a3-afe2aadad187] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 44320. May 26 21:38:38.257973 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c27c9b49-ca5c-45ec-bd34-7195b44925f1 tempest-TestShelveInstance-1289386847 tempest-TestShelveInstance-1289386847-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-854379751" status: 202 len: 0 microversion: 2.1 time: 1.091704 May 26 21:38:38.258568 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 567/1179] 10.222.0.42 () {58 vars in 1250 bytes} [Thu May 26 21:38:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-854379751 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:39:08.682556 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:08.683138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:08.686011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:08.686661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:08.691449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:08.691945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:08.692720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:08.693153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:08.716707 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-778838c7-6d21-4f38-a149-a5ac36eb591c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/ips" status: 200 len: 149 microversion: 2.1 time: 0.037920 May 26 21:39:08.717278 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 613/1180] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:39:08 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:10.256051 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=20 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:10.256791 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:10.261602 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "384c617c-9492-4c06-8117-019b208b8eab"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:10.263169 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:10.269102 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:10.269582 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:10.271396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:10.271396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:11.082517 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c8282950-39e7-4bf7-b862-9b56353582c0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "POST /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827803 May 26 21:39:11.083120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 568/1181] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:39:10 2022] POST /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:14.708187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:14.709115 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:14.718060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.718506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.719307 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.719767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.750708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3692137e-3f34-4073-9b1b-f2f7c8b24df2 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046314 May 26 21:39:14.751276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 614/1182] 10.222.0.42 () {60 vars in 1342 bytes} [Thu May 26 21:39:14 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:14.817874 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:14.818533 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:14.825550 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.826031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.826807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.827246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.853292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:39:15.123296 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b2174030-637c-4e65-8751-b033e5594a05 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 204 len: 0 microversion: 2.20 time: 0.309771 May 26 21:39:15.123916 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 569/1183] 10.222.0.42 () {60 vars in 1279 bytes} [Thu May 26 21:39:14 2022] DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 21:39:15.132819 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:15.133426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:15.140724 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:15.141183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:15.141947 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:15.142384 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:15.271875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:15.279906 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:15.281437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:15.282601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-40bde1f1-be73-43ec-9104-b803427d6195 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.154507 May 26 21:39:15.283168 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 615/1184] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:15 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:39:16.301410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:16.302101 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:16.308625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:16.309071 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:16.310467 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:16.310903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:16.445254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:16.453916 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:16.455431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:16.456604 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bdac3683-2bdf-4472-87bb-1c2b4f8a78a0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.159559 May 26 21:39:16.457155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 570/1185] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:16 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:39:17.474483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:17.476031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:17.481843 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:17.482297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:17.483073 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:17.483506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:17.615040 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:17.623471 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:17.625162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:17.630396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d9e53c88-9a87-4a8d-9bf8-99f2a844c0fe tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1724 microversion: 2.20 time: 0.155770 May 26 21:39:17.630396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 616/1186] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:17 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:39:18.076760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-018b3519-cee5-4db7-b00e-09e9c6901e2b req-c615557f-7867-4934-8c82-082bfc4369e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d396708c-5036-4133-a056-0f74ecc6011a", "name": "network-vif-deleted", "tag": "de23d676-5627-421b-905b-f6cea35f9243"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:18.085909 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-018b3519-cee5-4db7-b00e-09e9c6901e2b req-c615557f-7867-4934-8c82-082bfc4369e2 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:18.086357 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-018b3519-cee5-4db7-b00e-09e9c6901e2b req-c615557f-7867-4934-8c82-082bfc4369e2 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:18.098032 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-018b3519-cee5-4db7-b00e-09e9c6901e2b req-c615557f-7867-4934-8c82-082bfc4369e2 service nova] Creating event network-vif-deleted:de23d676-5627-421b-905b-f6cea35f9243 for instance d396708c-5036-4133-a056-0f74ecc6011a on hv-cinder-82880 May 26 21:39:18.103305 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-018b3519-cee5-4db7-b00e-09e9c6901e2b req-c615557f-7867-4934-8c82-082bfc4369e2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 May 26 21:39:18.103946 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 571/1187] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:18.644427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:18.645048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:18.651596 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:18.652155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:18.653497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:18.654114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:18.685451 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:18.685902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:18.686354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lazy-loading 'fault' on Instance uuid d396708c-5036-4133-a056-0f74ecc6011a {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:39:18.737983 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:18.746894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:18.748558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b94748ea78342629281f2360a54bee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f69588fe354d20b58594919deb4110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:18.749790 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c45c7289-43c1-479c-a8c8-f9c0aa2d3bec tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 200 len: 1372 microversion: 2.20 time: 0.109397 May 26 21:39:18.750449 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 617/1188] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:18 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:39:19.729146 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:19.729728 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:19.736531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:19.736977 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:19.737740 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:19.738180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:19.775963 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:19.776779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:19.783437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:19.783923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:19.784690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:19.785122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:19.799636 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] HTTP exception thrown: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Request method failure captured: May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a HTTP/1.1 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_CpJcnQs6qrgIsxkNWYrsxgO62o8ujaIA1G-yytFj1e5mQJJIyoN3-pPMrZVaWAlIUG1AZiGgdfUBXYWu_m3f23zWTOmzCfgbzLieYfspNt9wecjkAbjzmgX3S3YZDvWTvtPDh0DCEe3mAt2TeKt41RsLn8T48Vr4f1Y7z8WE8SVYE May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:19.801290 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5f69588fe354d20b58594919deb4110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5f69588fe354d20b58594919deb4110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}] May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 9b94748ea78342629281f2360a54bee4 May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:19.804492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': 'd396708c-5036-4133-a056-0f74ecc6011a'} May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:19.806223 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:19.809163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:19.812533 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Returning 404 to user: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:19.812533 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c1ef4188-9cf3-45cb-bf39-0a8161c3f0f9 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 404 len: 111 microversion: 2.20 time: 0.030579 May 26 21:39:19.812533 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 618/1189] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:19 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 21:39:19.812533 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cff7d558-00c7-477e-a52e-6cc9c5411883 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '.version_select at 0x7f7bc54feca0>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:19.833222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'services' on Instance uuid 9330f59f-5bf2-4fa6-a660-052cde3c4356 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:39:19.907140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cff7d558-00c7-477e-a52e-6cc9c5411883 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498945762" status: 204 len: 0 microversion: 2.20 time: 0.099435 May 26 21:39:19.907769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 619/1190] 10.222.0.42 () {60 vars in 1261 bytes} [Thu May 26 21:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498945762 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 21:39:20.042413 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0fe39f94-fccf-4d36-a8b7-a9c6a6e8880c tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments/384c617c-9492-4c06-8117-019b208b8eab" status: 202 len: 0 microversion: 2.1 time: 0.317643 May 26 21:39:20.043164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 572/1191] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:39:19 2022] DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments/384c617c-9492-4c06-8117-019b208b8eab => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:39:20.052584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:20.053705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:20.060763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:20.061219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:20.061999 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:20.062439 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:20.094993 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-35e6652c-d0f9-4897-ae05-7d49f55954a0 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 May 26 21:39:20.095579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 620/1192] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:39:20 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:21.107301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:21.108332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:21.115349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.115819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.116590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.117019 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.149815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-47abcbee-c44d-45f3-ba54-c0bc7c618ce7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046837 May 26 21:39:21.150402 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 573/1193] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:39:21 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:39:21.218801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:21.219422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:21.225964 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.226409 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.227162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.227590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.254087 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:39:21.524096 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c4087cb3-e0e6-4d2e-994b-720f1cdabf04 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 204 len: 0 microversion: 2.1 time: 0.308920 May 26 21:39:21.524718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 621/1194] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:39:21 2022] DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:39:21.533339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:21.534728 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:21.540285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.540734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.541504 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.541932 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.674095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:21.681718 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dd7145b1-454a-4cbe-ba74-e902b97b92b7 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1680 microversion: 2.1 time: 0.152238 May 26 21:39:21.682291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 574/1195] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:21 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:22.030903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:22.031481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:22.037835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.038291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.039062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.039501 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.053533 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] HTTP exception thrown: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Request method failure captured: May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a HTTP/1.1 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_CpJcnQs6qrgIsxkNWYrsxgO62o8ujaIA1G-yytFj1e5mQJJIyoN3-pPMrZVaWAlIUG1AZiGgdfUBXYWu_m3f23zWTOmzCfgbzLieYfspNt9wecjkAbjzmgX3S3YZDvWTvtPDh0DCEe3mAt2TeKt41RsLn8T48Vr4f1Y7z8WE8SVYE May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:22.055203 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5f69588fe354d20b58594919deb4110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5f69588fe354d20b58594919deb4110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}] May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 9b94748ea78342629281f2360a54bee4 May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.056951 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': 'd396708c-5036-4133-a056-0f74ecc6011a'} May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:22.057933 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.059867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:22.061312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Returning 404 to user: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:22.061312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-850572c6-e2dd-4280-a790-42e56b034cc0 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 404 len: 111 microversion: 2.20 time: 0.029972 May 26 21:39:22.061312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 622/1196] 10.222.0.42 () {60 vars in 1279 bytes} [Thu May 26 21:39:22 2022] DELETE /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:39:22.065670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:22.066290 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: d396708c-5036-4133-a056-0f74ecc6011a] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:22.072379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.072831 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.073598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.074042 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.087421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] HTTP exception thrown: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Request method failure captured: May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a HTTP/1.1 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_CpJcnQs6qrgIsxkNWYrsxgO62o8ujaIA1G-yytFj1e5mQJJIyoN3-pPMrZVaWAlIUG1AZiGgdfUBXYWu_m3f23zWTOmzCfgbzLieYfspNt9wecjkAbjzmgX3S3YZDvWTvtPDh0DCEe3mAt2TeKt41RsLn8T48Vr4f1Y7z8WE8SVYE May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:39:22.089076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5f69588fe354d20b58594919deb4110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5f69588fe354d20b58594919deb4110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}] May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 9b94748ea78342629281f2360a54bee4 May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.090760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': 'd396708c-5036-4133-a056-0f74ecc6011a'} May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:22.091711 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. May 26 21:39:22.092974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:22.094253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Returning 404 to user: Instance d396708c-5036-4133-a056-0f74ecc6011a could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:22.094253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0deec5ba-0eb1-47a9-9df6-398e522b77b4 tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a" status: 404 len: 111 microversion: 2.20 time: 0.028678 May 26 21:39:22.094253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 575/1197] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:22 2022] GET /compute/v2.1/servers/d396708c-5036-4133-a056-0f74ecc6011a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:39:22.704630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:22.705296 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:22.711834 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.712287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.713042 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.713474 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.845347 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:22.854648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9ce9da60-d168-46eb-836e-2c49f594ffda tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1680 microversion: 2.1 time: 0.153867 May 26 21:39:22.855207 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 623/1198] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:22 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:23.349199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:23.349731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:23.356393 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.356850 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.357680 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.358120 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.372214 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] HTTP exception thrown: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Request method failure captured: May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 HTTP/1.1 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_CpJcnQs6qrgIsxkNWYrsxgO62o8ujaIA1G-yytFj1e5mQJJIyoN3-pPMrZVaWAlIUG1AZiGgdfUBXYWu_m3f23zWTOmzCfgbzLieYfspNt9wecjkAbjzmgX3S3YZDvWTvtPDh0DCEe3mAt2TeKt41RsLn8T48Vr4f1Y7z8WE8SVYE May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:39:23.373787 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5f69588fe354d20b58594919deb4110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5f69588fe354d20b58594919deb4110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}] May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 9b94748ea78342629281f2360a54bee4 May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.375496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '73c36399-8b1a-4b08-b284-8a3900a10d73'} May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:23.377206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.378735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:23.380250 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Returning 404 to user: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:23.380250 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3f860fc1-9560-4239-a88c-46661533976a tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 404 len: 111 microversion: 2.20 time: 0.029867 May 26 21:39:23.380250 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 576/1199] 10.222.0.42 () {60 vars in 1279 bytes} [Thu May 26 21:39:23 2022] DELETE /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:39:23.383690 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:23.384523 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] [instance: 73c36399-8b1a-4b08-b284-8a3900a10d73] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:23.391112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.391559 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.392342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.392783 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.406593 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] HTTP exception thrown: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Request method failure captured: May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 HTTP/1.1 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_CpJcnQs6qrgIsxkNWYrsxgO62o8ujaIA1G-yytFj1e5mQJJIyoN3-pPMrZVaWAlIUG1AZiGgdfUBXYWu_m3f23zWTOmzCfgbzLieYfspNt9wecjkAbjzmgX3S3YZDvWTvtPDh0DCEe3mAt2TeKt41RsLn8T48Vr4f1Y7z8WE8SVYE May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:23.408187 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5f69588fe354d20b58594919deb4110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5f69588fe354d20b58594919deb4110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5f69588fe354d20b58594919deb4110"}]}] May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: c5f69588fe354d20b58594919deb4110 May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167781355 May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 9b94748ea78342629281f2360a54bee4 May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167781355-project May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.409779 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '73c36399-8b1a-4b08-b284-8a3900a10d73'} May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:23.410829 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. May 26 21:39:23.419244 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:23.420872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] Returning 404 to user: Instance 73c36399-8b1a-4b08-b284-8a3900a10d73 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:23.420872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7e33b729-82ad-4891-bcbf-11fe4f86024d tempest-AttachVolumeShelveTestJSON-167781355 tempest-AttachVolumeShelveTestJSON-167781355-project] 10.222.0.42 "GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73" status: 404 len: 111 microversion: 2.20 time: 0.029819 May 26 21:39:23.420872 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 624/1200] 10.222.0.42 () {60 vars in 1276 bytes} [Thu May 26 21:39:23 2022] GET /compute/v2.1/servers/73c36399-8b1a-4b08-b284-8a3900a10d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:39:23.871179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:23.872212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:23.879943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.881065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.881506 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.884598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:24.113862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:24.121715 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-94c2162b-6aba-4d46-ba51-77fedf5d5db5 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1680 microversion: 2.1 time: 0.254570 May 26 21:39:24.131876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 577/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:23 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:24.714797 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-1bb013c8-32d3-4678-8e92-7ed8ea2ad7b5 req-ef17c16b-9476-4045-9220-8cf4936e2f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9330f59f-5bf2-4fa6-a660-052cde3c4356", "name": "network-vif-deleted", "tag": "c5e60f5a-5490-4fca-a70a-4cc7266c0f9e"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:24.726727 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1bb013c8-32d3-4678-8e92-7ed8ea2ad7b5 req-ef17c16b-9476-4045-9220-8cf4936e2f04 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:24.728238 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1bb013c8-32d3-4678-8e92-7ed8ea2ad7b5 req-ef17c16b-9476-4045-9220-8cf4936e2f04 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:24.768562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-1bb013c8-32d3-4678-8e92-7ed8ea2ad7b5 req-ef17c16b-9476-4045-9220-8cf4936e2f04 service nova] Creating event network-vif-deleted:c5e60f5a-5490-4fca-a70a-4cc7266c0f9e for instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 on hv-cinder-82880 May 26 21:39:24.777094 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-1bb013c8-32d3-4678-8e92-7ed8ea2ad7b5 req-ef17c16b-9476-4045-9220-8cf4936e2f04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066615 May 26 21:39:24.783932 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 625/1202] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:25.142731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:25.144209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:25.151941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.152398 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.153196 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.153636 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.190294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.191300 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.191844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lazy-loading 'fault' on Instance uuid 9330f59f-5bf2-4fa6-a660-052cde3c4356 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:39:25.240732 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6214705ae31e459891f7a215f45a4cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969075d983246cf8c4c7a45a57d5338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:25.250998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ba0230b8-b4e8-4f78-8107-da60f9aef55b tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 200 len: 1331 microversion: 2.1 time: 0.112884 May 26 21:39:25.260944 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 578/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:25 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:26.275722 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:26.276371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:26.283193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:26.283193 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:26.283992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:26.286931 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:26.299771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 HTTP/1.1 May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:26.301425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:26.302865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '9330f59f-5bf2-4fa6-a660-052cde3c4356'} May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:26.303646 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:26.304972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:26.306148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:26.306148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b4975404-a97d-4391-b95a-ade31225f28a tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 404 len: 111 microversion: 2.1 time: 0.031937 May 26 21:39:26.306148 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 626/1204] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:26 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:26.312548 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-11a1a27c-c965-49ee-8a11-8bb774d9dfdf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '.version_select at 0x7f7bc4dc0040>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:26.418118 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-11a1a27c-c965-49ee-8a11-8bb774d9dfdf tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111046698" status: 202 len: 0 microversion: 2.1 time: 0.109935 May 26 21:39:26.423254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 579/1205] 10.222.0.42 () {58 vars in 1220 bytes} [Thu May 26 21:39:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111046698 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:39:28.779323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:28.782599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:28.786505 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.786960 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.787713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.788210 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.801904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 HTTP/1.1 May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:28.803421 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.805080 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '9330f59f-5bf2-4fa6-a660-052cde3c4356'} May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:28.805967 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.807190 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:28.808442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:28.808442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2005d835-a4df-42d9-a80b-970acfcb3121 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 404 len: 111 microversion: 2.1 time: 0.029437 May 26 21:39:28.808442 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 627/1206] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:39:28 2022] DELETE /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:28.814333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:28.814943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 9330f59f-5bf2-4fa6-a660-052cde3c4356] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:28.822288 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.822736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.823514 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.823995 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.837706 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 HTTP/1.1 May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:39:28.839239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.841002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '9330f59f-5bf2-4fa6-a660-052cde3c4356'} May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:28.841978 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. May 26 21:39:28.843562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:28.847158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 9330f59f-5bf2-4fa6-a660-052cde3c4356 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:28.847158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-82080d57-059d-4afe-a535-e148f5bbec27 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356" status: 404 len: 111 microversion: 2.1 time: 0.031304 May 26 21:39:28.847158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 580/1207] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:28 2022] GET /compute/v2.1/servers/9330f59f-5bf2-4fa6-a660-052cde3c4356 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:30.172284 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:30.172902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:30.179577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.180064 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.186944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.186944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.195392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e HTTP/1.1 May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:30.196968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.198550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '31344c9e-84b8-4fc4-9804-30732b08d70e'} May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:30.199599 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.201185 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.203497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:30.203497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-21d7027c-bb92-4d93-882c-c56c125987e4 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 404 len: 111 microversion: 2.1 time: 0.030314 May 26 21:39:30.203497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 628/1208] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:39:30 2022] DELETE /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:30.207537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:30.214455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 31344c9e-84b8-4fc4-9804-30732b08d70e] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:30.214798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.215245 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.216026 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.216460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.229477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e HTTP/1.1 May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:39:30.231010 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.232815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '31344c9e-84b8-4fc4-9804-30732b08d70e'} May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:30.234400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. May 26 21:39:30.235960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.237275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 31344c9e-84b8-4fc4-9804-30732b08d70e could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:30.237275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d93ff498-20f5-4f62-8c18-5eed2a7b4444 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e" status: 404 len: 111 microversion: 2.1 time: 0.028815 May 26 21:39:30.237275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 581/1209] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:30 2022] GET /compute/v2.1/servers/31344c9e-84b8-4fc4-9804-30732b08d70e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:30.241727 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:30.241887 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:30.247966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.248416 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.249729 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.250112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.263904 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab HTTP/1.1 May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:30.266165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.267621 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': 'f47b8242-7a18-4ea5-b647-3ac7c275bdab'} May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:30.268925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.270666 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:30.272436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:30.272436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-66c1704c-0293-4abe-9bb7-d1d81401c114 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 404 len: 111 microversion: 2.1 time: 0.030607 May 26 21:39:30.272436 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 629/1210] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:39:30 2022] DELETE /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:39:30.276607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:30.278821 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: f47b8242-7a18-4ea5-b647-3ac7c275bdab] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:30.283442 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.283926 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.284685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.285119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.299982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab HTTP/1.1 May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:39:30.301520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.308223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': 'f47b8242-7a18-4ea5-b647-3ac7c275bdab'} May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:30.309815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. May 26 21:39:30.312375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:30.314658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance f47b8242-7a18-4ea5-b647-3ac7c275bdab could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:30.314658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e5c5f93e-0f27-481d-b035-7e13f79bd697 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab" status: 404 len: 111 microversion: 2.1 time: 0.030308 May 26 21:39:30.314658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 582/1211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:30 2022] GET /compute/v2.1/servers/f47b8242-7a18-4ea5-b647-3ac7c275bdab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:39:31.598663 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:31.599167 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:31.606323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.606784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.607560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.608269 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.623628 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 HTTP/1.1 May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:39:31.625939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.627608 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '94bec145-b7bb-413b-a4ee-124c14212c63'} May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:31.631209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.632648 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:39:31.633896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:31.633896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-55896c25-cbd7-4aab-8702-3ce74bdd2523 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 404 len: 111 microversion: 2.1 time: 0.032534 May 26 21:39:31.633896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 630/1212] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:39:31 2022] DELETE /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:31.642450 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:31.643128 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] [instance: 94bec145-b7bb-413b-a4ee-124c14212c63] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:31.650661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.651567 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.652608 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.653539 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.671463 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] HTTP exception thrown: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Request method failure captured: May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 HTTP/1.1 May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_Cy700Pi8wH3UJWQXAqr-eL1WRbpY7uaSUeq6wafG-4SvsZBNBTSvI7SYyn252dTKNNLjPgnloaw8WuNHebEn5_lB80L86QpXCrACpoCs3VpVykhFjiPEQVQtgXzjaeqsGzhfKZp1YxotOiaflWg-cWj05lvFfgzTZtzLRHC0rAYqY May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:39:31.673135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3969075d983246cf8c4c7a45a57d5338"}]}] May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 3969075d983246cf8c4c7a45a57d5338 May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1509882702 May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 6214705ae31e459891f7a215f45a4cb2 May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeNegativeTest-1509882702-project May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.674688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '94bec145-b7bb-413b-a4ee-124c14212c63'} May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:39:31.680573 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. May 26 21:39:31.682528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:39:31.683875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] Returning 404 to user: Instance 94bec145-b7bb-413b-a4ee-124c14212c63 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:39:31.683875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8dcc1538-e63c-47c1-99bc-14a3080c6917 tempest-AttachVolumeNegativeTest-1509882702 tempest-AttachVolumeNegativeTest-1509882702-project] 10.222.0.42 "GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63" status: 404 len: 111 microversion: 2.1 time: 0.041033 May 26 21:39:31.683875 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 583/1213] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:31 2022] GET /compute/v2.1/servers/94bec145-b7bb-413b-a4ee-124c14212c63 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:39:36.029493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4412e5b6-fdf4-455c-92c4-3ad1ada68bd5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: .version_select at 0x7f7bc5680160>, body: {"keypair": {"name": "tempest-keypair-916308302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxuIvIDgKa+cfWtbT2n/bf85+6vFEt4c8dWc3fnl6CjDWZDJWu8OYxiqW8QvTD+UUdUhhzNeYnDasqckzetZXC8KtF+xSxUKbjN2W5NrByjfbhaVI12KgErr5nyaT9mAg=="}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:36.047377 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-4412e5b6-fdf4-455c-92c4-3ad1ada68bd5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for project fe887b2709bc446c8198c3d141c353af. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:39:36.051944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-4412e5b6-fdf4-455c-92c4-3ad1ada68bd5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for user 63e98f6491344656a94e199575494def and project fe887b2709bc446c8198c3d141c353af. Resources: {'key_pairs'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:39:36.200013 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4412e5b6-fdf4-455c-92c4-3ad1ada68bd5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.366045 May 26 21:39:36.200534 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 631/1214] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:39:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:38.744185 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2021140774", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d882acc-8185-427d-b7ca-6a150ac29628"}], "security_groups": [{"name": "tempest-securitygroup--732217686"}], "key_name": "tempest-keypair-916308302", "user_data": "}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:38.860480 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] validate_networks() for [('8d882acc-8185-427d-b7ca-6a150ac29628', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:39:39.297551 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:39:39.297976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:39:39.298455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:39:39.298865 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:39:39.299427 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:39:39.308410 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:39.308862 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:39.309866 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:39.310266 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:39.327886 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for project fe887b2709bc446c8198c3d141c353af. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:39:39.332162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for user 63e98f6491344656a94e199575494def and project fe887b2709bc446c8198c3d141c353af. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:39:39.344513 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:39:39.346872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:39:39.469570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9c0eb90f-b8f1-4fea-b232-8471f7c1d248 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.729540 May 26 21:39:39.470919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 584/1215] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:39:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:39:39.480288 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bb01498b-8380-4efd-96b2-65da15bbec9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:39.480978 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bb01498b-8380-4efd-96b2-65da15bbec9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:39.551601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bb01498b-8380-4efd-96b2-65da15bbec9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:39.561029 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bb01498b-8380-4efd-96b2-65da15bbec9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1237 microversion: 2.1 time: 0.084586 May 26 21:39:39.562499 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 632/1216] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:39 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:39:40.579124 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:40.579769 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:40.581760 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:40.586691 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:40.587138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:40.587969 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:40.588467 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:40.594706 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:40.657348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:40.664964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-13f9b797-16a9-49a7-98c7-59dfafc9c9b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1241 microversion: 2.1 time: 0.090353 May 26 21:39:40.665531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 585/1217] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:40 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:41.681806 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:41.685862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:41.686516 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:41.692899 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:41.693513 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:41.694237 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:41.694777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:41.762883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:41.771577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-40f7c3e8-cc16-4468-9071-ff94ba2a56b6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1297 microversion: 2.1 time: 0.091172 May 26 21:39:41.772177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 633/1218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:41 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:42.793867 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:42.794754 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:42.802587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:42.803126 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:42.804000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:42.804659 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:43.064982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:43.072969 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d586a356-e825-4bb7-ad12-870f809b2cef tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.285078 May 26 21:39:43.083358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 586/1219] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:42 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:43.705716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-94f55f19-891c-4f75-be9e-22026e640c50 req-5ba0fb55-2c16-452a-9081-604f74f2869f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8693fdb4-b4bb-4887-9074-425572842c02", "tag": "3e627b0d-06ff-49a1-bb6f-667e9115ac0d"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:43.718881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-94f55f19-891c-4f75-be9e-22026e640c50 req-5ba0fb55-2c16-452a-9081-604f74f2869f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:43.718881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-94f55f19-891c-4f75-be9e-22026e640c50 req-5ba0fb55-2c16-452a-9081-604f74f2869f service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:43.731708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-94f55f19-891c-4f75-be9e-22026e640c50 req-5ba0fb55-2c16-452a-9081-604f74f2869f service nova] Creating event network-changed:3e627b0d-06ff-49a1-bb6f-667e9115ac0d for instance 8693fdb4-b4bb-4887-9074-425572842c02 on hv-cinder-82880 May 26 21:39:43.737837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-94f55f19-891c-4f75-be9e-22026e640c50 req-5ba0fb55-2c16-452a-9081-604f74f2869f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035862 May 26 21:39:43.738435 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 634/1220] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:44.090501 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:44.091262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:44.099437 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:44.099933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:44.100974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:44.101390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:44.319958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:44.328415 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-158d0773-eef3-4f0e-8478-cc279e9dab2c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.241140 May 26 21:39:44.329081 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 587/1221] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:44 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:45.346155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:45.346858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:45.348854 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:45.354179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:45.354630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:45.355407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:45.355877 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:45.495617 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:45.505394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-8941a41e-f572-4225-9189-75279e8cd08e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.164332 May 26 21:39:45.505985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 635/1222] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:45 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:46.522530 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:46.523174 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:46.529947 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:46.530397 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:46.531855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:46.532347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:46.673800 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:46.682571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-41da4ed0-dbd9-4b70-b040-43795d018624 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.162817 May 26 21:39:46.682571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 588/1223] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:46 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:47.698643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:47.699343 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:47.707192 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:47.707638 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:47.708472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:47.709432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:47.840952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:47.849055 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-62f595a5-fecc-4f86-8742-842869673c34 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.154374 May 26 21:39:47.849627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 636/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:47 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:48.867276 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:48.867948 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:48.874145 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:48.874594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:48.875980 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:48.876421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:49.010280 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:49.018580 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-66e9ca90-5b82-430c-a3fa-df3f120448f5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.155877 May 26 21:39:49.019137 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 589/1225] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:48 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:50.040143 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:50.040916 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:50.043097 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=6 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:50.048408 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.048862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.050660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.050660 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.182155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:50.189924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d77761cc-7594-446c-af58-01686f6ba861 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.153565 May 26 21:39:50.190492 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 637/1226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:50 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:50.822240 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-bb70d79f-c85c-4724-92ce-ac7c923e245e req-2cfcc03e-c620-4ea6-bfac-6116bcaa6162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8693fdb4-b4bb-4887-9074-425572842c02", "name": "network-vif-plugged", "status": "completed", "tag": "3e627b0d-06ff-49a1-bb6f-667e9115ac0d"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:50.827092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:50.837655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:50.837655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-bb70d79f-c85c-4724-92ce-ac7c923e245e req-2cfcc03e-c620-4ea6-bfac-6116bcaa6162 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.837655 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-bb70d79f-c85c-4724-92ce-ac7c923e245e req-2cfcc03e-c620-4ea6-bfac-6116bcaa6162 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.846972 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-bb70d79f-c85c-4724-92ce-ac7c923e245e req-2cfcc03e-c620-4ea6-bfac-6116bcaa6162 service nova] Creating event network-vif-plugged:3e627b0d-06ff-49a1-bb6f-667e9115ac0d for instance 8693fdb4-b4bb-4887-9074-425572842c02 on hv-cinder-82880 May 26 21:39:50.852495 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-bb70d79f-c85c-4724-92ce-ac7c923e245e req-2cfcc03e-c620-4ea6-bfac-6116bcaa6162 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034387 May 26 21:39:50.853109 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 590/1227] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:51.206772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:51.207379 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:51.214158 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:51.214612 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:51.215396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:51.215861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:51.359959 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:51.368108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bdb250a3-bad6-437f-a231-65e81c4054a9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.165425 May 26 21:39:51.368700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 638/1228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:51 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:52.386673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:52.387372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:52.394063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:52.394507 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:52.395271 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:52.395707 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:52.545246 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:52.554570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ce78c16c-6cab-42b3-905d-cff9904641fd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1362 microversion: 2.1 time: 0.172510 May 26 21:39:52.554570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 591/1229] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:52 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:53.571322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:53.572023 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:53.578813 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.579265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.580135 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.580609 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.745527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:39:53.754426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3c0e58bb-a585-4c4f-83ca-66bfcc271c1b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1547 microversion: 2.1 time: 0.187268 May 26 21:39:53.758312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 639/1230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:39:53 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1547 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:39:53.774949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:53.775566 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:53.782181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.782634 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.783419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.783888 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.864512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5d75b751-c63e-4cb7-8ac1-f841d0d8ff2d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093439 May 26 21:39:53.865099 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 592/1231] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:39:53 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:55.141785 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-fe4620c3-2243-4c09-b6a8-98542f550ba7 req-abec1d57-2d9c-45ca-81db-dc34bf43f5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8693fdb4-b4bb-4887-9074-425572842c02", "tag": "3e627b0d-06ff-49a1-bb6f-667e9115ac0d"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:39:55.151909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-fe4620c3-2243-4c09-b6a8-98542f550ba7 req-abec1d57-2d9c-45ca-81db-dc34bf43f5f8 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:55.153091 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-fe4620c3-2243-4c09-b6a8-98542f550ba7 req-abec1d57-2d9c-45ca-81db-dc34bf43f5f8 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:55.166138 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-fe4620c3-2243-4c09-b6a8-98542f550ba7 req-abec1d57-2d9c-45ca-81db-dc34bf43f5f8 service nova] Creating event network-changed:3e627b0d-06ff-49a1-bb6f-667e9115ac0d for instance 8693fdb4-b4bb-4887-9074-425572842c02 on hv-cinder-82880 May 26 21:39:55.172518 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-fe4620c3-2243-4c09-b6a8-98542f550ba7 req-abec1d57-2d9c-45ca-81db-dc34bf43f5f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036289 May 26 21:39:55.173289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 640/1232] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:19.823567 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:40:19.824285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:40:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:40:22.769782 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=15 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:22.774255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=11 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:22.774894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=41 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:22.778963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:22.785637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:22.786251 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=40 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:22.786650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.787239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.788155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.788665 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.817906 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:40:22.920357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-c8206ca9-6333-4f52-b256-1a7d7cb03bb5 req-3fd1c56d-5217-4571-b328-3dfc6ba4f6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb2a3109-7643-4486-9b81-c1ab0c30d882", "tag": "fcb1b6ae-a8e4-40da-a068-0102dba09fcf"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:22.928798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-c8206ca9-6333-4f52-b256-1a7d7cb03bb5 req-3fd1c56d-5217-4571-b328-3dfc6ba4f6b8 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.929246 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-c8206ca9-6333-4f52-b256-1a7d7cb03bb5 req-3fd1c56d-5217-4571-b328-3dfc6ba4f6b8 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.941229 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-c8206ca9-6333-4f52-b256-1a7d7cb03bb5 req-3fd1c56d-5217-4571-b328-3dfc6ba4f6b8 service nova] Creating event network-changed:fcb1b6ae-a8e4-40da-a068-0102dba09fcf for instance fb2a3109-7643-4486-9b81-c1ab0c30d882 on hv-cinder-82880 May 26 21:40:22.946953 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-c8206ca9-6333-4f52-b256-1a7d7cb03bb5 req-3fd1c56d-5217-4571-b328-3dfc6ba4f6b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175022 May 26 21:40:22.947561 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 641/1233] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:23.146291 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b10d05e0-00f3-448b-a913-1f2f4990781c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 204 len: 0 microversion: 2.1 time: 0.378322 May 26 21:40:23.146918 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 593/1234] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:40:22 2022] DELETE /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:40:23.156260 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:23.156956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:23.163693 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:23.164651 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:23.165905 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:23.166342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:23.302077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:23.311397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-59243d8a-b6a7-4a55-871b-30b632de2b36 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1574 microversion: 2.1 time: 0.159215 May 26 21:40:23.312019 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 642/1235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:23 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:24.331273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:24.332002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:24.339262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:24.339703 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:24.340557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:24.341001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:24.515294 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:24.522554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-01026453-5cef-4138-871c-d3dbb0a73df0 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1574 microversion: 2.1 time: 0.195600 May 26 21:40:24.523425 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 594/1236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:24 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:25.467712 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-22581fe2-4369-4a46-8daf-983466ccf9c8 req-71203b3f-706d-443d-819a-d2883c4811d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb2a3109-7643-4486-9b81-c1ab0c30d882", "name": "network-vif-deleted", "tag": "fcb1b6ae-a8e4-40da-a068-0102dba09fcf"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:25.484716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-22581fe2-4369-4a46-8daf-983466ccf9c8 req-71203b3f-706d-443d-819a-d2883c4811d7 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.485736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-22581fe2-4369-4a46-8daf-983466ccf9c8 req-71203b3f-706d-443d-819a-d2883c4811d7 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.498422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-22581fe2-4369-4a46-8daf-983466ccf9c8 req-71203b3f-706d-443d-819a-d2883c4811d7 service nova] Creating event network-vif-deleted:fcb1b6ae-a8e4-40da-a068-0102dba09fcf for instance fb2a3109-7643-4486-9b81-c1ab0c30d882 on hv-cinder-82880 May 26 21:40:25.504383 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-22581fe2-4369-4a46-8daf-983466ccf9c8 req-71203b3f-706d-443d-819a-d2883c4811d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044530 May 26 21:40:25.505003 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 643/1237] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:25.550072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:25.550687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:25.558213 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.558663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.559454 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.559928 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.626235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:25.634933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4856b581-c180-47b7-a889-5ff016533f08 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1390 microversion: 2.1 time: 0.089139 May 26 21:40:25.635528 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 595/1238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:25 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:26.654189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:26.654880 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:26.661402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.661847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.662667 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.663130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.704574 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.705013 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.705459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lazy-loading 'fault' on Instance uuid fb2a3109-7643-4486-9b81-c1ab0c30d882 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:40:26.752494 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:26.761464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f77fc512-60d3-4d29-87d5-71123e05db6a tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 200 len: 1229 microversion: 2.1 time: 0.112639 May 26 21:40:26.762051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 644/1239] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:26 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:27.779029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:27.779618 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: fb2a3109-7643-4486-9b81-c1ab0c30d882] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:27.786477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:27.786929 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:27.787698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:27.788164 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:27.803606 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] HTTP exception thrown: Instance fb2a3109-7643-4486-9b81-c1ab0c30d882 could not be found. May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Request method failure captured: May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 HTTP/1.1 May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_EgJ2FHpPbSPISU30Rq3PmZJwaeAo3qDERSSArI9eZNKjmGn9TE9UKE7HIwXbNFpU_tNkW8Rx6p3e0udsgCyvGbEOkh8aXh90-xuZu1sMB8ZZOSGBhsXR3TwEc4YL9LNnJL_UvcXOkPFSZLZjFcZzya8jDxKrfstz8ZNap5XXCtaqA May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:40:27.805293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}] May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 88575c0bd9db4fa8bc9bd511c0ac37dd May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance fb2a3109-7643-4486-9b81-c1ab0c30d882 could not be found. May 26 21:40:27.806988 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': 'fb2a3109-7643-4486-9b81-c1ab0c30d882'} May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb2a3109-7643-4486-9b81-c1ab0c30d882 could not be found. May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:40:27.807893 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb2a3109-7643-4486-9b81-c1ab0c30d882 could not be found. May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb2a3109-7643-4486-9b81-c1ab0c30d882 could not be found. May 26 21:40:27.809547 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:27.812011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Returning 404 to user: Instance fb2a3109-7643-4486-9b81-c1ab0c30d882 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:40:27.812011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c15a6e74-7086-486a-b214-59d545259f1c tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882" status: 404 len: 111 microversion: 2.1 time: 0.031588 May 26 21:40:27.812011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 596/1240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:27 2022] GET /compute/v2.1/servers/fb2a3109-7643-4486-9b81-c1ab0c30d882 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:40:31.206074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:31.206590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:31.208424 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-2a7167c6-d2da-429a-8a59-eb24c40a7f45 req-1ffaeba8-d59b-47fe-992e-fe429d38568e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972688e1-313a-4ed5-8a32-87deda4e5198", "tag": "79857899-1ec0-48de-8faf-2f5625a3ec41"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:31.214031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.214486 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.215263 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.215920 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.218611 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-2a7167c6-d2da-429a-8a59-eb24c40a7f45 req-1ffaeba8-d59b-47fe-992e-fe429d38568e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.219287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-2a7167c6-d2da-429a-8a59-eb24c40a7f45 req-1ffaeba8-d59b-47fe-992e-fe429d38568e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.231293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-2a7167c6-d2da-429a-8a59-eb24c40a7f45 req-1ffaeba8-d59b-47fe-992e-fe429d38568e service nova] Creating event network-changed:79857899-1ec0-48de-8faf-2f5625a3ec41 for instance 972688e1-313a-4ed5-8a32-87deda4e5198 on hv-cinder-82880 May 26 21:40:31.236670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-2a7167c6-d2da-429a-8a59-eb24c40a7f45 req-1ffaeba8-d59b-47fe-992e-fe429d38568e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032691 May 26 21:40:31.237688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 597/1241] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:31.245400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Going to try to terminate instance {{(pid=118557) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:40:31.649283 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-94795e5e-25b1-4b1e-823b-3b019180f679 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 204 len: 0 microversion: 2.1 time: 0.446633 May 26 21:40:31.649939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 645/1242] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:40:31 2022] DELETE /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:40:31.658731 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:31.661688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:31.666594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.667041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.668362 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.668998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.845699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:31.855484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a06fac8a-8f22-42d9-b4a7-4c6dc2711f3d tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1576 microversion: 2.1 time: 0.200813 May 26 21:40:31.856116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 598/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:31 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:32.875053 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:32.875781 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:32.883394 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:32.884060 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:32.884858 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:32.885295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:33.054682 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:33.063589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4fb2ab17-1ab2-4d50-ab8e-a322813699da tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1457 microversion: 2.1 time: 0.193813 May 26 21:40:33.064213 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 646/1244] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:32 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1457 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:33.184477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-b13ec297-3b21-421b-9592-784dfce01d23 req-a2b66bc1-4f38-433e-8c97-3a65af5fd95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972688e1-313a-4ed5-8a32-87deda4e5198", "name": "network-vif-deleted", "tag": "79857899-1ec0-48de-8faf-2f5625a3ec41"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:33.194905 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-b13ec297-3b21-421b-9592-784dfce01d23 req-a2b66bc1-4f38-433e-8c97-3a65af5fd95d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:33.196114 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-b13ec297-3b21-421b-9592-784dfce01d23 req-a2b66bc1-4f38-433e-8c97-3a65af5fd95d service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:33.210598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-b13ec297-3b21-421b-9592-784dfce01d23 req-a2b66bc1-4f38-433e-8c97-3a65af5fd95d service nova] Creating event network-vif-deleted:79857899-1ec0-48de-8faf-2f5625a3ec41 for instance 972688e1-313a-4ed5-8a32-87deda4e5198 on hv-cinder-82880 May 26 21:40:33.217390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-b13ec297-3b21-421b-9592-784dfce01d23 req-a2b66bc1-4f38-433e-8c97-3a65af5fd95d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038665 May 26 21:40:33.218072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 599/1245] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:34.082557 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:34.083155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:34.089969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:34.090416 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:34.091199 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:34.091637 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:34.124773 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:34.125219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:34.125787 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lazy-loading 'fault' on Instance uuid 972688e1-313a-4ed5-8a32-87deda4e5198 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:40:34.170862 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88575c0bd9db4fa8bc9bd511c0ac37dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d8cb3f18ae4f05a85dc21abaf316cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:34.178847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9ef0eb05-2fb5-4e18-a791-9c052da245ad tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 200 len: 1228 microversion: 2.1 time: 0.101763 May 26 21:40:34.179495 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 647/1246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:34 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:35.198817 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:35.199596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 972688e1-313a-4ed5-8a32-87deda4e5198] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:35.206069 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.206519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.207286 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.207889 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.221997 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] HTTP exception thrown: Instance 972688e1-313a-4ed5-8a32-87deda4e5198 could not be found. May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Request method failure captured: May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 HTTP/1.1 May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_EgJ2FHpPbSPISU30Rq3PmZJwaeAo3qDERSSArI9eZNKjmGn9TE9UKE7HIwXbNFpU_tNkW8Rx6p3e0udsgCyvGbEOkh8aXh90-xuZu1sMB8ZZOSGBhsXR3TwEc4YL9LNnJL_UvcXOkPFSZLZjFcZzya8jDxKrfstz8ZNap5XXCtaqA May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:40:35.223613 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}] May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 88575c0bd9db4fa8bc9bd511c0ac37dd May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 972688e1-313a-4ed5-8a32-87deda4e5198 could not be found. May 26 21:40:35.225422 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '972688e1-313a-4ed5-8a32-87deda4e5198'} May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972688e1-313a-4ed5-8a32-87deda4e5198 could not be found. May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:40:35.226400 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972688e1-313a-4ed5-8a32-87deda4e5198 could not be found. May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972688e1-313a-4ed5-8a32-87deda4e5198 could not be found. May 26 21:40:35.227842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:35.228976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Returning 404 to user: Instance 972688e1-313a-4ed5-8a32-87deda4e5198 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:40:35.228976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-508b06d0-1c62-4b54-8853-213ced2c63fb tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198" status: 404 len: 111 microversion: 2.1 time: 0.031650 May 26 21:40:35.228976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 600/1247] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:35 2022] GET /compute/v2.1/servers/972688e1-313a-4ed5-8a32-87deda4e5198 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:40:35.966640 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:35.967177 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:35.973625 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.974074 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.974835 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.975271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.988507 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] HTTP exception thrown: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Request method failure captured: May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: DELETE /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 HTTP/1.1 May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_EgJ2FHpPbSPISU30Rq3PmZJwaeAo3qDERSSArI9eZNKjmGn9TE9UKE7HIwXbNFpU_tNkW8Rx6p3e0udsgCyvGbEOkh8aXh90-xuZu1sMB8ZZOSGBhsXR3TwEc4YL9LNnJL_UvcXOkPFSZLZjFcZzya8jDxKrfstz8ZNap5XXCtaqA May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:40:35.990140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}] May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 88575c0bd9db4fa8bc9bd511c0ac37dd May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:35.991695 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '3e2b4ade-df77-4c06-bfc0-2a510bfe37d5'} May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:40:35.993392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:35.994956 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:40:35.996522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Returning 404 to user: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:40:35.996522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6f76f1a2-df82-445b-a408-6b1c7e4a05df tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 404 len: 111 microversion: 2.1 time: 0.028761 May 26 21:40:35.996522 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 648/1248] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:40:35 2022] DELETE /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:40:36.000940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:36.001738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] [instance: 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:36.008552 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:36.008938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:36.009714 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:36.010149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:36.024891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] HTTP exception thrown: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Request method failure captured: May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 HTTP/1.1 May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_EgJ2FHpPbSPISU30Rq3PmZJwaeAo3qDERSSArI9eZNKjmGn9TE9UKE7HIwXbNFpU_tNkW8Rx6p3e0udsgCyvGbEOkh8aXh90-xuZu1sMB8ZZOSGBhsXR3TwEc4YL9LNnJL_UvcXOkPFSZLZjFcZzya8jDxKrfstz8ZNap5XXCtaqA May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:40:36.026431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/87d8cb3f18ae4f05a85dc21abaf316cb"}]}] May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 87d8cb3f18ae4f05a85dc21abaf316cb May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024582870 May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 88575c0bd9db4fa8bc9bd511c0ac37dd May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-TestVolumeBootPattern-1024582870-project May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:36.028202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '3e2b4ade-df77-4c06-bfc0-2a510bfe37d5'} May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:40:36.029122 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. May 26 21:40:36.030650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:40:36.032031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Returning 404 to user: Instance 3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:40:36.032031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6cd5db1a-4189-4657-878d-63a2bdd74e49 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5" status: 404 len: 111 microversion: 2.1 time: 0.030983 May 26 21:40:36.032031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 601/1249] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:35 2022] GET /compute/v2.1/servers/3e2b4ade-df77-4c06-bfc0-2a510bfe37d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:40:37.538281 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d3d55490-35d7-4378-b766-15841b8393e5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] Calling method '.version_select at 0x7f7bc517c310>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:37.653882 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d3d55490-35d7-4378-b766-15841b8393e5 tempest-TestVolumeBootPattern-1024582870 tempest-TestVolumeBootPattern-1024582870-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-80832212" status: 202 len: 0 microversion: 2.1 time: 0.119482 May 26 21:40:37.654732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 649/1250] 10.222.0.42 () {58 vars in 1256 bytes} [Thu May 26 21:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-80832212 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:40:47.881365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1027837258", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "networks": [{"uuid": "882df593-7113-40d8-9c12-94b4548143c4"}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:47.889848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:47.890537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:47.941472 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] validate_networks() for [('882df593-7113-40d8-9c12-94b4548143c4', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:40:48.282669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:40:48.283089 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:40:48.283561 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:40:48.284007 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:40:48.284419 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:40:48.294034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:48.294478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:48.295292 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:48.295726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:48.312314 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Getting quotas for project 512bd83d26b94036b9067e2998520c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:40:48.316253 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Getting quotas for user f9e999bf4c7e4edda7f004c63a287e8f and project 512bd83d26b94036b9067e2998520c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:40:48.328429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:40:48.330650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:40:48.426358 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4f5b04ca-cbed-4b5a-8660-1b0d3d5e9b84 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549148 May 26 21:40:48.427001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 602/1251] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:40:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 21:40:48.437736 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d3ba0800-1fde-4030-ad50-9a0ab28cdbff tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:48.438559 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d3ba0800-1fde-4030-ad50-9a0ab28cdbff tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:48.441576 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:48.443324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:48.496809 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d3ba0800-1fde-4030-ad50-9a0ab28cdbff tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:48.504025 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d3ba0800-1fde-4030-ad50-9a0ab28cdbff tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1214 microversion: 2.1 time: 0.070044 May 26 21:40:48.504603 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 650/1252] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:48 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:49.521643 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:49.522206 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:49.529138 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:49.529586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:49.530359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:49.530795 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:49.604651 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:49.613072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-adbae463-91dd-4210-8667-fef0cc401934 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1218 microversion: 2.1 time: 0.095843 May 26 21:40:49.613709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 603/1253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:49 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:50.630995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:50.631628 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:50.639971 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:50.640425 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:50.641205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:50.641624 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:50.710658 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:50.719302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2530621c-2421-4fe4-a60f-b97d1974dc30 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1274 microversion: 2.1 time: 0.092771 May 26 21:40:50.735769 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 651/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:50 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:51.736620 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:51.737470 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:51.744009 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:51.744478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:51.745245 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:51.745677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:51.925514 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:51.934738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-0a45c739-4682-4b47-9001-ceabb0472082 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.201990 May 26 21:40:51.935352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 604/1255] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:51 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:52.219130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-1aca6358-eb5c-4f5a-9c0c-8dc1715ceb93 req-c4fc2f04-680e-40b7-8a0e-c452b2e02841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea316ac9-48e6-445a-9e44-26271f6d77b2", "tag": "41d6cc8e-73e8-4201-80e8-4b733a4e8148"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:52.228116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1aca6358-eb5c-4f5a-9c0c-8dc1715ceb93 req-c4fc2f04-680e-40b7-8a0e-c452b2e02841 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.231985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-1aca6358-eb5c-4f5a-9c0c-8dc1715ceb93 req-c4fc2f04-680e-40b7-8a0e-c452b2e02841 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:52.241875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-1aca6358-eb5c-4f5a-9c0c-8dc1715ceb93 req-c4fc2f04-680e-40b7-8a0e-c452b2e02841 service nova] Creating event network-changed:41d6cc8e-73e8-4201-80e8-4b733a4e8148 for instance ea316ac9-48e6-445a-9e44-26271f6d77b2 on hv-cinder-82880 May 26 21:40:52.246584 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-1aca6358-eb5c-4f5a-9c0c-8dc1715ceb93 req-c4fc2f04-680e-40b7-8a0e-c452b2e02841 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031264 May 26 21:40:52.247173 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 652/1256] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:52.954923 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:52.955891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:52.965377 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.965840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:52.966699 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.968110 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:53.124766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:53.132625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-38c3d400-1cbc-4a14-a8fa-de335ed00efc tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.184367 May 26 21:40:53.133218 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 605/1257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:52 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:54.151085 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:54.151798 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:54.158147 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:54.158597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:54.159361 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:54.159814 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:54.296333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:54.303881 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f73affd1-fd6a-4281-a297-e01c479e2c77 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.157502 May 26 21:40:54.304446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 653/1258] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:54 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:55.321487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:55.322585 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:55.329137 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:55.329598 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:55.330364 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:55.330804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:55.458021 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:55.466201 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-08c15fd7-ecf2-4ad6-b836-49da0092a947 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.148748 May 26 21:40:55.466756 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 606/1259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:55 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:56.483462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:56.486647 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:56.490827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:56.491265 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:56.492075 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:56.492510 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:56.621149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:56.628620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7ecb355c-7164-4b7a-8c82-473d20c27c6e tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.149112 May 26 21:40:56.629178 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 654/1260] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:56 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:57.646131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:57.646750 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:57.654332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:57.654788 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:57.655570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:57.656049 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:57.789178 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:57.796931 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-521e8e28-0872-419d-8b64-0b0fac0ebf38 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.154910 May 26 21:40:57.797488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 607/1261] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:57 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:58.813604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:58.814122 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:58.816594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:58.821437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:58.822389 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:58.823152 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:58.823589 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:58.955922 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:40:58.964380 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-409c1fd2-ef39-49cc-9051-6aa046a7ef96 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.154678 May 26 21:40:58.964957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 655/1262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:58 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:40:59.154263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-4cfb464e-f480-4ca1-a591-51bcf08274e3 req-3de2852e-bb1b-47f4-83bb-dd84b914536e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea316ac9-48e6-445a-9e44-26271f6d77b2", "name": "network-vif-plugged", "status": "completed", "tag": "41d6cc8e-73e8-4201-80e8-4b733a4e8148"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:40:59.157774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:59.158453 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:59.164197 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-4cfb464e-f480-4ca1-a591-51bcf08274e3 req-3de2852e-bb1b-47f4-83bb-dd84b914536e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.165211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-4cfb464e-f480-4ca1-a591-51bcf08274e3 req-3de2852e-bb1b-47f4-83bb-dd84b914536e service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:59.177736 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-4cfb464e-f480-4ca1-a591-51bcf08274e3 req-3de2852e-bb1b-47f4-83bb-dd84b914536e service nova] Creating event network-vif-plugged:41d6cc8e-73e8-4201-80e8-4b733a4e8148 for instance ea316ac9-48e6-445a-9e44-26271f6d77b2 on hv-cinder-82880 May 26 21:40:59.182920 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-4cfb464e-f480-4ca1-a591-51bcf08274e3 req-3de2852e-bb1b-47f4-83bb-dd84b914536e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 May 26 21:40:59.183692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 608/1263] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:59.981926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:59.982525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:59.989320 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.989768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:59.990525 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.990958 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:00.117120 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:00.125024 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fe9f79e6-17b3-44a3-be91-031353533954 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.147570 May 26 21:41:00.125594 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 656/1264] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:40:59 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:01.143688 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:01.144356 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:01.152609 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:01.153059 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:01.153945 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:01.154395 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:01.289510 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:01.297834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2aee98ce-e724-4147-84f2-1027b61e38ec tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1314 microversion: 2.1 time: 0.159099 May 26 21:41:01.298526 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 609/1265] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:01 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:02.320818 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:02.321375 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:02.328506 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:02.328957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:02.329724 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:02.330163 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:02.460392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:02.468457 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b19a5483-a9d3-4a90-b46a-9d50eac75e18 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1498 microversion: 2.1 time: 0.151532 May 26 21:41:02.469044 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 657/1266] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:02 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:03.281535 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:03.282047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:03.288610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.289066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.289825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.290263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.317433 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:41:03.602993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a23f1e19-1fd9-460a-9d80-4e8528e4f23a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 204 len: 0 microversion: 2.1 time: 0.325033 May 26 21:41:03.603584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 610/1267] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:41:03 2022] DELETE /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:41:03.612976 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:03.613590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:03.622333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.622784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.623981 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.624086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.758624 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:03.766775 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3eece3e3-8e8e-4bff-b920-7c7f1910f41a tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1504 microversion: 2.1 time: 0.157848 May 26 21:41:03.767350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 658/1268] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:03 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:04.783857 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:04.784562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:04.791111 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:04.791586 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:04.792647 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:04.793092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:04.923833 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:04.931361 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cfb3819c-150f-4f99-9fc4-0fc70e85fafb tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1504 microversion: 2.1 time: 0.151801 May 26 21:41:04.932005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 611/1269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:04 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:05.783112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-864f0e7a-5cd6-4a99-a481-607b460cc920 req-1c65cd2f-6944-46c4-9c8f-8e84ae74f573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea316ac9-48e6-445a-9e44-26271f6d77b2", "name": "network-vif-deleted", "tag": "41d6cc8e-73e8-4201-80e8-4b733a4e8148"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:05.796708 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-864f0e7a-5cd6-4a99-a481-607b460cc920 req-1c65cd2f-6944-46c4-9c8f-8e84ae74f573 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.798980 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-864f0e7a-5cd6-4a99-a481-607b460cc920 req-1c65cd2f-6944-46c4-9c8f-8e84ae74f573 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:05.819845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-864f0e7a-5cd6-4a99-a481-607b460cc920 req-1c65cd2f-6944-46c4-9c8f-8e84ae74f573 service nova] Creating event network-vif-deleted:41d6cc8e-73e8-4201-80e8-4b733a4e8148 for instance ea316ac9-48e6-445a-9e44-26271f6d77b2 on hv-cinder-82880 May 26 21:41:05.829261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-864f0e7a-5cd6-4a99-a481-607b460cc920 req-1c65cd2f-6944-46c4-9c8f-8e84ae74f573 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049359 May 26 21:41:05.829943 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 659/1270] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:05.949650 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:05.950546 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:05.958478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.959073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:05.960188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.960748 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:06.022953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:06.030512 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6b33b21e-65a7-4b3c-8205-74cb150810f9 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 200 len: 1299 microversion: 2.1 time: 0.086076 May 26 21:41:06.031072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 612/1271] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:05 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:41:07.048889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:07.049536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: ea316ac9-48e6-445a-9e44-26271f6d77b2] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:07.055847 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.056305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.057680 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.058121 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.071369 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] HTTP exception thrown: Instance ea316ac9-48e6-445a-9e44-26271f6d77b2 could not be found. May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Request method failure captured: May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 HTTP/1.1 May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_PdzawjPor1RrgfAm_7oposx6LNTBa-UFzYUXA_419miTnHFtyrc1XVmbJjcL795MoYygC5oHNGjs7AcqjNXmSEWDDnA8CJlve5jhjtoRokCVdfBpLVopa4qiV3jdLsuQ1umlLuubWWjEEWa7k5FjWiS3YI7DmRaQJRFIZoo56sVGI May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: 512bd83d26b94036b9067e2998520c4d May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesActionsTest-1568283248 May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:41:07.073008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_512bd83d26b94036b9067e2998520c4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/512bd83d26b94036b9067e2998520c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/512bd83d26b94036b9067e2998520c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/512bd83d26b94036b9067e2998520c4d"}]}] May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesActionsTest-1568283248 May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: 512bd83d26b94036b9067e2998520c4d May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesActionsTest-1568283248 May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesActionsTest-1568283248-project May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: f9e999bf4c7e4edda7f004c63a287e8f May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesActionsTest-1568283248-project May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance ea316ac9-48e6-445a-9e44-26271f6d77b2 could not be found. May 26 21:41:07.074772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': 'ea316ac9-48e6-445a-9e44-26271f6d77b2'} May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea316ac9-48e6-445a-9e44-26271f6d77b2 could not be found. May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:41:07.075677 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea316ac9-48e6-445a-9e44-26271f6d77b2 could not be found. May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea316ac9-48e6-445a-9e44-26271f6d77b2 could not be found. May 26 21:41:07.077315 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:41:07.078748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Returning 404 to user: Instance ea316ac9-48e6-445a-9e44-26271f6d77b2 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:41:07.078748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d1305b6e-10f1-4bb8-8882-cf6f757efe86 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2" status: 404 len: 111 microversion: 2.1 time: 0.030426 May 26 21:41:07.078748 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 660/1272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:07 2022] GET /compute/v2.1/servers/ea316ac9-48e6-445a-9e44-26271f6d77b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:41:07.176639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-337315602", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "networks": [{"uuid": "882df593-7113-40d8-9c12-94b4548143c4"}]}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:07.230763 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] validate_networks() for [('882df593-7113-40d8-9c12-94b4548143c4', None, None, None, None, None)] {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:41:07.572299 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:41:07.572888 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:41:07.573380 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:41:07.573789 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:41:07.574198 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:41:07.582959 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.583411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.584255 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.584723 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.602012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Getting quotas for project 512bd83d26b94036b9067e2998520c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:41:07.606490 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Getting quotas for user f9e999bf4c7e4edda7f004c63a287e8f and project 512bd83d26b94036b9067e2998520c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:41:07.617492 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:41:07.619846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:41:07.764516 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3f261bce-e383-41e5-8345-bce924d8346f tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591839 May 26 21:41:07.765172 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 613/1273] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:41:07.775174 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9e459251-f014-4af7-a0fc-e2f325ae5314 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:07.776489 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9e459251-f014-4af7-a0fc-e2f325ae5314 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:07.840050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9e459251-f014-4af7-a0fc-e2f325ae5314 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:07.847346 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9e459251-f014-4af7-a0fc-e2f325ae5314 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1213 microversion: 2.1 time: 0.075894 May 26 21:41:07.848144 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 661/1274] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:07 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:41:08.864846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:08.865725 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:08.875686 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:08.876165 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:08.876948 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:08.877394 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:08.942131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:08.949963 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-70c96522-ef4e-4e66-81ef-5e2283ade9ea tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1209 microversion: 2.1 time: 0.089677 May 26 21:41:08.950531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 614/1275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:08 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:09.966622 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:09.967595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:09.976048 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:09.979737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:09.979737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:09.979737 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:10.064768 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:10.073036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-364e2327-fda0-4860-a253-7c76712b54c0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1271 microversion: 2.1 time: 0.110123 May 26 21:41:10.073617 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 662/1276] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:09 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:11.091503 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:11.092792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:11.094112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-eb84fe77-647a-40a1-af6f-9b9269db7575 req-48dc13d5-c39f-4dfa-86ed-ceb29e630cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02b4d0b-9031-4101-97cd-34354693e77d", "tag": "ce4f0c1d-542e-45fb-a9ba-07bc8bbdd479"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:11.099622 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.100113 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.101108 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.101545 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.104581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-eb84fe77-647a-40a1-af6f-9b9269db7575 req-48dc13d5-c39f-4dfa-86ed-ceb29e630cbc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.105116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-eb84fe77-647a-40a1-af6f-9b9269db7575 req-48dc13d5-c39f-4dfa-86ed-ceb29e630cbc service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.121470 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-eb84fe77-647a-40a1-af6f-9b9269db7575 req-48dc13d5-c39f-4dfa-86ed-ceb29e630cbc service nova] Creating event network-changed:ce4f0c1d-542e-45fb-a9ba-07bc8bbdd479 for instance e02b4d0b-9031-4101-97cd-34354693e77d on hv-cinder-82880 May 26 21:41:11.126560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-eb84fe77-647a-40a1-af6f-9b9269db7575 req-48dc13d5-c39f-4dfa-86ed-ceb29e630cbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036609 May 26 21:41:11.127562 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 663/1277] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:11.324000 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:11.332053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9b289ea4-a4e3-4ed3-b5a3-47489b82eba5 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.245152 May 26 21:41:11.332631 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 615/1278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:11 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:12.349853 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:12.350464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:12.356942 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:12.357392 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:12.358166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:12.358606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:12.487236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:12.494751 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b324ea28-32df-4d1f-bd35-1f3e4ded221c tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.149690 May 26 21:41:12.495312 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 664/1279] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:12 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:13.512654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:13.513184 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:13.519775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:13.520224 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:13.520987 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:13.521421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:13.652018 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:13.659366 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e18060fb-2295-458f-a165-925b339aee20 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.151422 May 26 21:41:13.659958 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 616/1280] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:13 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:14.676342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:14.676953 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:14.684243 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:14.684616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:14.685389 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:14.685826 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:14.820109 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:14.827491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0f18cb33-2f66-48b7-891c-bedc493dbe13 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.155020 May 26 21:41:14.828086 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 665/1281] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:14 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:15.844677 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:15.845221 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:15.851754 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:15.852202 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:15.852951 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:15.853386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:15.981379 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:15.988750 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e5729300-969b-4f78-9e75-965c302ce4e6 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.148169 May 26 21:41:15.989312 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 617/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:15 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:17.006050 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:17.006662 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:17.013129 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.013581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.020211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.020211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.145745 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:17.154021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-dbf9db53-7bee-4c08-9dad-92184fa3a49b tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.151671 May 26 21:41:17.154731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 666/1283] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:17 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:17.256469 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-247d2d45-d398-4520-bcd6-122b9ac704cc req-2327c0e5-5394-4e95-9f54-c1edd342ca77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02b4d0b-9031-4101-97cd-34354693e77d", "name": "network-vif-plugged", "status": "completed", "tag": "ce4f0c1d-542e-45fb-a9ba-07bc8bbdd479"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:17.266372 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-247d2d45-d398-4520-bcd6-122b9ac704cc req-2327c0e5-5394-4e95-9f54-c1edd342ca77 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.266819 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-247d2d45-d398-4520-bcd6-122b9ac704cc req-2327c0e5-5394-4e95-9f54-c1edd342ca77 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.278810 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-247d2d45-d398-4520-bcd6-122b9ac704cc req-2327c0e5-5394-4e95-9f54-c1edd342ca77 service nova] Creating event network-vif-plugged:ce4f0c1d-542e-45fb-a9ba-07bc8bbdd479 for instance e02b4d0b-9031-4101-97cd-34354693e77d on hv-cinder-82880 May 26 21:41:17.283939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-247d2d45-d398-4520-bcd6-122b9ac704cc req-2327c0e5-5394-4e95-9f54-c1edd342ca77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032009 May 26 21:41:17.284541 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 618/1284] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:18.171128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:18.171700 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:18.173654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:18.178487 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:18.178932 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:18.179689 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:18.180149 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:18.313206 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:18.321063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0c8f0266-ebc4-4cb0-a478-775304209724 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.154473 May 26 21:41:18.321632 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 667/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:18 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:19.334882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:19.335822 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:19.341181 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:19.341901 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:19.343770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:19.349321 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:19.349772 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:19.350557 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:19.351012 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:19.355509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:19.494034 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:19.502207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ba23b6f2-0243-47a9-a9a2-bc96c3b508de tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1313 microversion: 2.1 time: 0.168148 May 26 21:41:19.502804 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 619/1286] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:19 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:20.520385 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:20.521049 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:20.528703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:20.529155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:20.529936 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:20.530446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:20.672747 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:20.680560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-11997cdd-5a1a-4eb6-a288-e0ca2d1b3cda tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1497 microversion: 2.1 time: 0.164220 May 26 21:41:20.681127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 668/1287] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:20 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:21.389254 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:21.389821 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:21.397455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.398174 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.398745 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.399212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.427488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:41:21.773284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9249754d-f11f-4ec1-97e4-225e9d46723d tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 204 len: 0 microversion: 2.1 time: 0.388082 May 26 21:41:21.773903 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 620/1288] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:41:21 2022] DELETE /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:41:21.782782 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:21.783397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:21.785796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=43 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:21.790571 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.791021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.792900 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.793347 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.923308 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:21.930711 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3fa0a3c1-6e24-401a-a5df-d838f45b71f0 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1503 microversion: 2.1 time: 0.152024 May 26 21:41:21.931271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 669/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:21 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:22.948324 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:22.949027 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:22.956107 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:22.956556 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:22.957369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:22.957755 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:23.085309 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:23.093658 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-66a4ea7c-9459-4042-aa49-89cc260bf310 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1503 microversion: 2.1 time: 0.149533 May 26 21:41:23.094233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 621/1290] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:22 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:23.872239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-f225318b-ac71-41e0-8f89-916c0b07dbf0 req-7ceccb9c-a18b-47de-af42-08e9ed1271f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02b4d0b-9031-4101-97cd-34354693e77d", "name": "network-vif-deleted", "tag": "ce4f0c1d-542e-45fb-a9ba-07bc8bbdd479"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:23.880867 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-f225318b-ac71-41e0-8f89-916c0b07dbf0 req-7ceccb9c-a18b-47de-af42-08e9ed1271f1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:23.881321 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-f225318b-ac71-41e0-8f89-916c0b07dbf0 req-7ceccb9c-a18b-47de-af42-08e9ed1271f1 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:23.885031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=93 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:23.892807 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-f225318b-ac71-41e0-8f89-916c0b07dbf0 req-7ceccb9c-a18b-47de-af42-08e9ed1271f1 service nova] Creating event network-vif-deleted:ce4f0c1d-542e-45fb-a9ba-07bc8bbdd479 for instance e02b4d0b-9031-4101-97cd-34354693e77d on hv-cinder-82880 May 26 21:41:23.897990 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-f225318b-ac71-41e0-8f89-916c0b07dbf0 req-7ceccb9c-a18b-47de-af42-08e9ed1271f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030192 May 26 21:41:23.898579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 670/1291] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:24.110571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:24.111132 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:24.117673 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.120438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.120438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.120438 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.184721 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e999bf4c7e4edda7f004c63a287e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512bd83d26b94036b9067e2998520c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:24.192611 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-932f96d5-5608-4ad8-a6c0-3f209a7a5d87 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 200 len: 1298 microversion: 2.1 time: 0.086013 May 26 21:41:24.193182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 622/1292] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:24 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:24.938864 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:24.942016 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:24.946334 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.946784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.947549 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.948011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.971717 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-860db3c5-7a0c-459f-90f0-9e1bd79c1879 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/ips" status: 200 len: 145 microversion: 2.1 time: 0.037548 May 26 21:41:24.972331 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 671/1293] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:41:24 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:25.210222 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:25.210792 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] [instance: e02b4d0b-9031-4101-97cd-34354693e77d] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:25.218348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:25.218803 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:25.219571 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:25.220047 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:25.233823 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] HTTP exception thrown: Instance e02b4d0b-9031-4101-97cd-34354693e77d could not be found. May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Request method failure captured: May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d HTTP/1.1 May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_PdzawjPor1RrgfAm_7oposx6LNTBa-UFzYUXA_419miTnHFtyrc1XVmbJjcL795MoYygC5oHNGjs7AcqjNXmSEWDDnA8CJlve5jhjtoRokCVdfBpLVopa4qiV3jdLsuQ1umlLuubWWjEEWa7k5FjWiS3YI7DmRaQJRFIZoo56sVGI May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: 512bd83d26b94036b9067e2998520c4d May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-VolumesActionsTest-1568283248 May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:41:25.235484 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_512bd83d26b94036b9067e2998520c4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/512bd83d26b94036b9067e2998520c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/512bd83d26b94036b9067e2998520c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/512bd83d26b94036b9067e2998520c4d"}]}] May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-VolumesActionsTest-1568283248 May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: 512bd83d26b94036b9067e2998520c4d May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-VolumesActionsTest-1568283248 May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-VolumesActionsTest-1568283248-project May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: f9e999bf4c7e4edda7f004c63a287e8f May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-VolumesActionsTest-1568283248-project May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance e02b4d0b-9031-4101-97cd-34354693e77d could not be found. May 26 21:41:25.237163 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': 'e02b4d0b-9031-4101-97cd-34354693e77d'} May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02b4d0b-9031-4101-97cd-34354693e77d could not be found. May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:41:25.238119 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02b4d0b-9031-4101-97cd-34354693e77d could not be found. May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02b4d0b-9031-4101-97cd-34354693e77d could not be found. May 26 21:41:25.239701 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:41:25.241190 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] Returning 404 to user: Instance e02b4d0b-9031-4101-97cd-34354693e77d could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:41:25.241190 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-13304ecc-a061-4008-98bc-9da28a5d04c1 tempest-VolumesActionsTest-1568283248 tempest-VolumesActionsTest-1568283248-project] 10.222.0.42 "GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d" status: 404 len: 111 microversion: 2.1 time: 0.030781 May 26 21:41:25.241190 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 623/1294] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:25 2022] GET /compute/v2.1/servers/e02b4d0b-9031-4101-97cd-34354693e77d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:41:27.365322 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebbda613-ec9c-4678-b4fc-5ef74ae610cb"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:27.366463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:27.373715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:27.374166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:27.374937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:27.375381 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:29.209555 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6fe546a6-b143-4ac1-a63f-bf9cf592b31f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.848264 May 26 21:41:29.210396 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 672/1295] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:41:27 2022] POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-volume_attachments => generated 194 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:39.972773 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-6731445c-a7e0-4ec5-ac8f-78b8b00d9be5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:39.976768 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:39.977941 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:39.992115 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6731445c-a7e0-4ec5-ac8f-78b8b00d9be5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:39.993046 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-6731445c-a7e0-4ec5-ac8f-78b8b00d9be5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.065689 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-6731445c-a7e0-4ec5-ac8f-78b8b00d9be5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Going to try to stop instance {{(pid=118558) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 21:41:40.243155 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-6731445c-a7e0-4ec5-ac8f-78b8b00d9be5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action" status: 202 len: 0 microversion: 2.1 time: 0.275842 May 26 21:41:40.243938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 624/1296] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:41:39 2022] POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:41:40.253703 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:40.257810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:40.264042 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=7 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:40.264820 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:40.266530 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:40.267570 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.268565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:40.269202 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.443160 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:40.455823 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-ad675020-a1e6-4a34-959b-a5a1a33e6704 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.206292 May 26 21:41:40.464335 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 673/1297] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:40 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:41.476359 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:41.477070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:41.483642 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:41.484129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:41.484910 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:41.485348 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:41.623396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:41.632098 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-c34418fc-a8a7-4785-9794-7c04fff7508a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.160922 May 26 21:41:41.632670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 625/1298] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:41 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:42.650794 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:42.651788 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:42.659306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:42.659888 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:42.660764 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:42.661297 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:42.824179 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:42.835171 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d040196f-bdd4-4b9b-b8df-cbfef81f9a85 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.188409 May 26 21:41:42.835909 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 674/1299] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:42 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:43.855350 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:43.856626 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:43.863996 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:43.873764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:43.873764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:43.873764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:44.064092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:44.075417 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-54d7ade4-baf6-4ec1-885a-a77cd54efd10 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.224467 May 26 21:41:44.076349 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 626/1300] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:43 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:45.095214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:45.095214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:45.102860 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:45.103287 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:45.104134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:45.104606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:45.293406 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:45.304157 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-31ac06f3-878b-4f6c-ae48-0e2bb85755ff tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.213785 May 26 21:41:45.318485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 675/1301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:45 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:46.331562 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:46.332375 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:46.343339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:46.344226 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:46.345251 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:46.345764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:46.482966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:46.492289 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e60c0c9b-60c0-4bc7-8aa0-dceac0bf977f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.166409 May 26 21:41:46.502858 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 627/1302] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:46 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:47.509828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:47.510447 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:47.517007 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:47.517459 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:47.518282 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:47.518741 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:47.658256 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:47.667641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-28325f83-509e-4a0b-b338-297129ae6fce tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.161570 May 26 21:41:47.677617 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 676/1303] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:47 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:48.684671 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:48.685283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:48.691457 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:48.691950 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:48.692733 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:48.693167 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:48.822648 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:48.831060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-8e2bf98f-ae10-428a-b0b9-ddf9e49f9895 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.149849 May 26 21:41:48.831622 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 628/1304] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:48 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:49.847969 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:49.848694 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:49.855127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:49.855572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:49.856379 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:49.856824 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:49.991734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:49.999767 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b51e367a-a903-4ea9-85d1-d7b02f31422d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.155787 May 26 21:41:50.000349 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 677/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:49 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:51.017166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:51.017798 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:51.025070 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:51.025524 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:51.026293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:51.026734 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:51.155386 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:51.163523 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-86b49045-9478-4abf-80b1-d5427a9f8471 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.150243 May 26 21:41:51.164129 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 629/1306] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:51 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:52.181326 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:52.182558 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:52.189446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:52.190131 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:52.190913 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:52.191360 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:52.328183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:52.336517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-9edaef72-412a-4e31-9220-abea590aaa28 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.159009 May 26 21:41:52.337104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 678/1307] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:52 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:53.354563 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:53.355180 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:53.362692 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:53.363149 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:53.363966 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:53.364471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:53.501233 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:53.510381 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-d1f9c508-462d-4df9-b1f2-42d74f311db0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.159688 May 26 21:41:53.511195 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 630/1308] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:53 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:54.529427 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:54.530042 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:54.537140 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:54.537587 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:54.538345 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:54.538778 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:54.686309 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:54.694692 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c04bb0ef-bff3-4295-b03d-3dcf271f35a6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.169268 May 26 21:41:54.698064 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 679/1309] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:54 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:41:55.712735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:55.713352 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:55.720153 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:55.720610 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:55.721943 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:55.722388 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:55.867568 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:55.875596 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4177d0eb-6ed8-4041-b57f-c5ca3af2bcfd tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1722 microversion: 2.1 time: 0.166791 May 26 21:41:55.876218 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 631/1310] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:55 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:56.892426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:56.893059 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:56.899529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:56.900001 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:56.900759 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:56.901197 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.240028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:57.245921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-2cc4a443-eafd-4458-b75e-9145936cc17d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1699 microversion: 2.1 time: 0.357399 May 26 21:41:57.246484 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 680/1311] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:56 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1699 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:57.263158 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5751c6e6-cdb3-4cc7-81d1-f5cc087e7406 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:41:57.269712 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5751c6e6-cdb3-4cc7-81d1-f5cc087e7406 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.270159 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5751c6e6-cdb3-4cc7-81d1-f5cc087e7406 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.293635 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5751c6e6-cdb3-4cc7-81d1-f5cc087e7406 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Going to try to start instance {{(pid=118558) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 21:41:57.425985 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5751c6e6-cdb3-4cc7-81d1-f5cc087e7406 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action" status: 202 len: 0 microversion: 2.1 time: 0.166464 May 26 21:41:57.426583 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 632/1312] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:41:57 2022] POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:41:57.434903 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:57.435520 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:57.441855 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.442352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.443133 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.443572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.579940 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:57.588572 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-a20ea5ef-7f2a-4ea5-9bd9-0dee447a6540 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1708 microversion: 2.1 time: 0.157549 May 26 21:41:57.589165 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 681/1313] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:57 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:58.608700 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:58.609443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:58.615824 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:58.616263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:58.617038 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:58.617478 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:58.807999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:58.816483 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-307b7c9f-41ce-498b-b46d-a6c1c5439e83 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1708 microversion: 2.1 time: 0.212139 May 26 21:41:58.817060 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 633/1314] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:58 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1708 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:41:59.833995 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:59.834804 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:59.841616 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:59.842063 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:59.842837 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:59.843310 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:59.978007 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:41:59.986027 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7322328d-3903-470e-ba6f-98d17e6ee126 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1712 microversion: 2.1 time: 0.156204 May 26 21:41:59.987205 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 682/1315] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:41:59 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1712 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:42:06.035256 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:42:06.035849 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:42:55.413218 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:55.414587 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:55.416477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=20 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:55.421999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:55.422232 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:55.422694 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:55.423482 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:55.423951 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:55.507884 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lazy-loading 'services' on Instance uuid 8693fdb4-b4bb-4887-9074-425572842c02 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:42:55.730166 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e23f939f-e709-4a7d-b58b-c6c167b05a95 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-volume_attachments/ebbda613-ec9c-4678-b4fc-5ef74ae610cb" status: 202 len: 0 microversion: 2.1 time: 0.321152 May 26 21:42:55.730745 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 634/1316] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:42:55 2022] DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-volume_attachments/ebbda613-ec9c-4678-b4fc-5ef74ae610cb => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:42:56.843701 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1242d501-9056-436a-a9a5-51ede4a4a01c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:42:56.845863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=20 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:56.846530 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=60 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:56.852134 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1242d501-9056-436a-a9a5-51ede4a4a01c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:56.852597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1242d501-9056-436a-a9a5-51ede4a4a01c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:56.915805 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1242d501-9056-436a-a9a5-51ede4a4a01c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Going to try to stop instance {{(pid=118557) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 21:42:57.105757 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1242d501-9056-436a-a9a5-51ede4a4a01c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action" status: 202 len: 0 microversion: 2.1 time: 0.265862 May 26 21:42:57.106289 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 683/1317] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:42:56 2022] POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:42:57.115794 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:57.116508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:57.122853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:57.123307 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:57.124110 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:57.124554 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:57.254257 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:42:57.264125 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a48c9311-e038-4e60-8002-d58a7ced5ea4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.153300 May 26 21:42:57.264934 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 635/1318] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:42:57 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:42:58.283643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:58.284444 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:58.291873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:58.292389 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:58.293214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:58.293661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:58.422630 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:42:58.430215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-323dceb3-0dfd-4082-9831-b0285f246b76 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.151670 May 26 21:42:58.430777 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 684/1319] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:42:58 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:42:59.448029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:59.448669 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:59.455267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:59.455709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:59.456499 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:59.456927 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:59.590031 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:42:59.597908 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-201cd2df-e632-4260-b47f-120bcf3df71b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.154447 May 26 21:42:59.598496 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 636/1320] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:42:59 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:00.615763 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:00.616371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:00.623423 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:00.623907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:00.624676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:00.625108 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:00.757439 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:00.764884 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0abf16b6-7ce6-4ea8-9433-464bdc0bebf3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.152992 May 26 21:43:00.765448 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 685/1321] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:00 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:01.782836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:01.783429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:01.790065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:01.790774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:01.791537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:01.791998 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:01.923799 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:01.931778 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-784de710-53d8-49a8-8500-35081fb3a8d0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.152901 May 26 21:43:01.932324 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 637/1322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:01 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:02.949139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:02.949733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:02.956240 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:02.956688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:02.957514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:02.957890 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:03.087613 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:03.095286 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7c698f89-d76e-4060-829a-32f8a076fedf tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.150558 May 26 21:43:03.095885 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 686/1323] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:02 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:04.112353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:04.112989 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:04.119450 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:04.119939 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:04.120709 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:04.121173 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:04.269322 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:04.277841 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f58ce6e1-1640-43c0-9ace-be4fe7134da5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.169297 May 26 21:43:04.278406 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 638/1324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:04 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:05.295615 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:05.296259 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:05.302970 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:05.303422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:05.304314 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:05.304749 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:05.442990 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:05.451295 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6164dd99-6874-4e4d-9627-0ba94f736703 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.159502 May 26 21:43:05.451896 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 687/1325] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:05 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:06.468330 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:06.468957 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:06.475771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:06.476813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:06.477708 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:06.478028 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:06.848569 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:06.856024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-76a7903c-9c05-4d7c-825a-fed0e934b6c3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.391542 May 26 21:43:06.856590 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 639/1326] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:06 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:07.873485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:07.874043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:07.880724 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:07.881176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:07.881973 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:07.882992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:08.010564 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:08.018083 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0a12eb49-9127-47e4-ac01-4538661c2509 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.148513 May 26 21:43:08.018645 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 688/1327] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:07 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:09.035728 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:09.036306 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:09.043024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:09.043471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:09.044287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:09.044726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:09.171521 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:09.179820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-92ca6ac8-0701-4755-abfa-43f85e27acf2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.148005 May 26 21:43:09.180392 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 640/1328] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:09 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:10.197189 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:10.197808 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:10.204791 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:10.204968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:10.205605 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:10.206043 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:10.333882 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:10.341350 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-1a566cec-73b1-440d-b655-e15611dc1565 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.148685 May 26 21:43:10.341916 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 689/1329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:10 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:11.358443 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:11.359053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:11.365785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:11.366243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:11.367029 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:11.367477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:11.498131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:11.505594 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a1057871-daa0-4771-9dcf-f7d8bb35ca92 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.151011 May 26 21:43:11.506156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 641/1330] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:11 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:12.522654 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:12.523254 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:12.530860 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:12.531305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:12.532109 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:12.532541 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:12.670546 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:12.678875 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4ea9d747-b585-4001-9bbc-d7025552046e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1676 microversion: 2.1 time: 0.160130 May 26 21:43:12.679483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 690/1331] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:12 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:13.696684 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:13.697295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:13.704389 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.709199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.709199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.709199 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.835217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:13.843001 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-be8384f6-aea6-4226-9947-63658baaf4e5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1653 microversion: 2.1 time: 0.150642 May 26 21:43:13.843576 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 642/1332] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:13 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1653 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:43:13.864485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5f79ddd1-d2cc-4ba6-a8dc-760f7e4a88e4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:43:13.871527 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5f79ddd1-d2cc-4ba6-a8dc-760f7e4a88e4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.872001 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5f79ddd1-d2cc-4ba6-a8dc-760f7e4a88e4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.894812 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5f79ddd1-d2cc-4ba6-a8dc-760f7e4a88e4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Going to try to start instance {{(pid=118557) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 21:43:14.060352 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5f79ddd1-d2cc-4ba6-a8dc-760f7e4a88e4 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action" status: 202 len: 0 microversion: 2.1 time: 0.199320 May 26 21:43:14.061103 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 691/1333] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 26 21:43:13 2022] POST /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:43:14.069621 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:14.070216 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:14.077063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:14.077519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:14.078297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:14.079207 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:14.214054 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:14.221896 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-15d9ec93-9b49-4358-a491-8ed0a1affe9e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1662 microversion: 2.1 time: 0.156339 May 26 21:43:14.222471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 643/1334] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:14 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:15.240467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:15.241262 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:15.248652 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:15.249102 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:15.249889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:15.250328 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:15.381488 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:15.389786 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-eb4b8473-63bc-4e34-b744-7999ceb384ee tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1662 microversion: 2.1 time: 0.153675 May 26 21:43:15.390354 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 692/1335] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:15 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:43:16.407407 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:16.407970 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:16.414451 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:16.414902 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:16.415964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:16.416401 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:16.550389 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:43:16.557848 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-35a5fa3a-aade-4538-80d2-7e33f31820a5 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1666 microversion: 2.1 time: 0.154441 May 26 21:43:16.558409 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 644/1336] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:43:16 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:43:39.837733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:43:39.838355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:43:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:43:55.402915 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:43:55.403565 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:44:02.008170 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:44:02.008761 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:44:11.422422 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:11.423407 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:11.425702 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=20 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:11.426355 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:11.431052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.431504 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.432291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.432727 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.462434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d06bad4e-d968-4f10-a25f-480698254b36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044023 May 26 21:44:11.462972 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 693/1337] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:44:11 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:44:11.520746 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:11.521267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:11.523487 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=22 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:11.524284 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:11.529063 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.536933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.536933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.536933 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.556237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:44:11.895429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-9e6ba63b-06e3-462d-906c-d75e5b6d256f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 204 len: 0 microversion: 2.1 time: 0.378231 May 26 21:44:11.896061 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 645/1338] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:44:11 2022] DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:44:11.904536 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:11.905181 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:11.912172 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.912626 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.913390 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.914342 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:12.048397 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:12.056720 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-c51b4ea1-fdd6-4a09-aa96-707f832304f9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1672 microversion: 2.1 time: 0.156408 May 26 21:44:12.057291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 694/1339] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:11 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:13.075221 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:13.075863 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:13.082704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:13.083156 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:13.083976 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:13.084418 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:13.216738 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:13.224235 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-379beea8-8b5c-44ae-adcf-5a38becd2765 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1672 microversion: 2.1 time: 0.153975 May 26 21:44:13.224795 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 646/1340] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:13 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:14.241305 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:14.242078 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:14.249114 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.249573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.250357 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.250802 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.383155 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:14.391227 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d194fe79-4f3a-43d8-8f3d-3506c880b40f tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1672 microversion: 2.1 time: 0.153778 May 26 21:44:14.391817 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 695/1341] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:14 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:14.907320 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-e3224bb6-d93d-4e33-bec7-559bcc2f77ef req-78d66cdd-a8b8-4bea-b5a6-5f0468e04177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8693fdb4-b4bb-4887-9074-425572842c02", "name": "network-vif-deleted", "tag": "3e627b0d-06ff-49a1-bb6f-667e9115ac0d"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:14.916713 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-e3224bb6-d93d-4e33-bec7-559bcc2f77ef req-78d66cdd-a8b8-4bea-b5a6-5f0468e04177 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.921282 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-e3224bb6-d93d-4e33-bec7-559bcc2f77ef req-78d66cdd-a8b8-4bea-b5a6-5f0468e04177 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.928534 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-e3224bb6-d93d-4e33-bec7-559bcc2f77ef req-78d66cdd-a8b8-4bea-b5a6-5f0468e04177 service nova] Creating event network-vif-deleted:3e627b0d-06ff-49a1-bb6f-667e9115ac0d for instance 8693fdb4-b4bb-4887-9074-425572842c02 on hv-cinder-82880 May 26 21:44:14.934336 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-e3224bb6-d93d-4e33-bec7-559bcc2f77ef req-78d66cdd-a8b8-4bea-b5a6-5f0468e04177 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 May 26 21:44:14.935162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 647/1342] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:15.409232 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:15.409828 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:15.417002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.417446 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.418291 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.418725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.453344 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.453795 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.454250 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lazy-loading 'fault' on Instance uuid 8693fdb4-b4bb-4887-9074-425572842c02 {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:44:15.506214 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:15.515245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-b8fba400-fd17-4430-bfab-797340cbfee0 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 200 len: 1327 microversion: 2.1 time: 0.109702 May 26 21:44:15.522008 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 696/1343] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:15 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:16.539112 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:16.540106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:16.547041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:16.547488 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:16.548279 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:16.548716 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:16.561813 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] HTTP exception thrown: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Request method failure captured: May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 HTTP/1.1 May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_OXMEl1IB3vvxq17jtUr7iaafgUpCONrhjnOmAWxqarGfyppSCtYyDxmoaKCe7G03ortD5UT6ovN2QbSU_O8ZMT8bu_o1YH5IYPoP720FgpC7VwcPOUlgFVC7S95QLfwD2RyGQtaA3s-Te-zrbqUkv7d2zceGta0xPwhtZz2JZZhMc May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: fe887b2709bc446c8198c3d141c353af May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:44:16.563411 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe887b2709bc446c8198c3d141c353af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}] May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeTestJSON-2035704259 May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: fe887b2709bc446c8198c3d141c353af May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 63e98f6491344656a94e199575494def May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:44:16.565219 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '8693fdb4-b4bb-4887-9074-425572842c02'} May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:44:16.566334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:44:16.568116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:44:16.569704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Returning 404 to user: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:44:16.569704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1eb3d4f9-847b-47a8-a367-c54f04d0d246 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 404 len: 111 microversion: 2.1 time: 0.029956 May 26 21:44:16.569704 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 648/1344] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:16 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:44:16.573998 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-58de64e5-e575-48d6-89f5-15d902ccec02 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '.version_select at 0x7f7bca650160>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:16.651077 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-58de64e5-e575-48d6-89f5-15d902ccec02 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916308302" status: 202 len: 0 microversion: 2.1 time: 0.081237 May 26 21:44:16.651733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 697/1345] 10.222.0.42 () {58 vars in 1217 bytes} [Thu May 26 21:44:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916308302 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:44:17.412891 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3eada269-b684-45ea-8121-e8590424730c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: .version_select at 0x7f7bc4be9430>, body: {"keypair": {"name": "tempest-keypair-1617083259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON5s826Cu6tsBmCYZ1NlN6ZnU+19+Prub4e0IATPP9V3Pvz20l786fF+m309qKwk6/NyB8pKHrAlk1cMa+Pr2KHryiekCbbi/tnn5aCxICL1l7Zy1gF4pXVO2arUdROOw=="}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:17.427846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-3eada269-b684-45ea-8121-e8590424730c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for project fe887b2709bc446c8198c3d141c353af. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:44:17.432423 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-3eada269-b684-45ea-8121-e8590424730c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for user 63e98f6491344656a94e199575494def and project fe887b2709bc446c8198c3d141c353af. Resources: {'key_pairs'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:44:17.523652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3eada269-b684-45ea-8121-e8590424730c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114436 May 26 21:44:17.524297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 649/1346] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 26 21:44:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:19.880643 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1791413335", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d882acc-8185-427d-b7ca-6a150ac29628"}], "security_groups": [{"name": "tempest-securitygroup--157261159"}], "key_name": "tempest-keypair-1617083259", "user_data": "}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:19.980128 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.network.neutron [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] validate_networks() for [('8d882acc-8185-427d-b7ca-6a150ac29628', None, None, None, None, None)] {{(pid=118557) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:44:20.383836 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Flavor limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:44:20.384266 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Image limits 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:44:20.384732 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Flavor pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:44:20.385137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Image pref 0:0:0 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:44:20.385604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.virt.hardware [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:44:20.395137 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:20.395883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:20.396733 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:20.397196 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:20.415057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for project fe887b2709bc446c8198c3d141c353af. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:44:20.419100 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.quota [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Getting quotas for user 63e98f6491344656a94e199575494def and project fe887b2709bc446c8198c3d141c353af. Resources: {'cores', 'ram', 'instances'} {{(pid=118557) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:44:20.431298 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Going to run 1 instances... {{(pid=118557) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:44:20.433641 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:44:20.548659 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-09789832-6c7b-487d-a2f5-c04595f2af41 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.672229 May 26 21:44:20.549324 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 698/1347] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:44:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:44:20.560346 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fc216c43-18f1-4326-b4d0-8776c52116e2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:20.560964 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fc216c43-18f1-4326-b4d0-8776c52116e2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:20.621853 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-fc216c43-18f1-4326-b4d0-8776c52116e2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:20.628549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fc216c43-18f1-4326-b4d0-8776c52116e2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1238 microversion: 2.1 time: 0.073004 May 26 21:44:20.629109 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 650/1348] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:20 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:21.645124 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:21.645734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:21.652285 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:21.652740 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:21.653509 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:21.653945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:21.717400 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:21.725105 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-6e057990-1527-49b1-9d34-0f90b0fea73e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1242 microversion: 2.1 time: 0.084443 May 26 21:44:21.725670 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 699/1349] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:21 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:22.742753 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:22.743509 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:22.750211 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:22.750667 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:22.751447 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:22.751919 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:22.823710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:22.831460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e341b4a1-2ae0-4a29-b932-56641a035c0c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1298 microversion: 2.1 time: 0.093086 May 26 21:44:22.832080 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 651/1350] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:22 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:23.849018 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:23.849766 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:23.857434 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:23.857568 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:23.858402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:23.858689 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:23.995887 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:24.003661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-bb2edfe8-318e-434f-83c0-93da3bc4603d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.158737 May 26 21:44:24.004276 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 700/1351] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:23 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:24.553362 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-fe430b90-e80e-49e1-95c1-b0b40e142413 req-f92abc23-0566-4525-88e3-cbcad77e2fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d246af8-6729-4eb7-8f7d-eec6ffc8b19b", "tag": "9251f567-e9e0-4ae4-b147-a2c109756c0c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:24.578864 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-fe430b90-e80e-49e1-95c1-b0b40e142413 req-f92abc23-0566-4525-88e3-cbcad77e2fe6 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:24.579326 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-fe430b90-e80e-49e1-95c1-b0b40e142413 req-f92abc23-0566-4525-88e3-cbcad77e2fe6 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:24.591477 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-fe430b90-e80e-49e1-95c1-b0b40e142413 req-f92abc23-0566-4525-88e3-cbcad77e2fe6 service nova] Creating event network-changed:9251f567-e9e0-4ae4-b147-a2c109756c0c for instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b on hv-cinder-82880 May 26 21:44:24.597064 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-fe430b90-e80e-49e1-95c1-b0b40e142413 req-f92abc23-0566-4525-88e3-cbcad77e2fe6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048026 May 26 21:44:24.601685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 652/1352] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:25.020723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:25.021327 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:25.028036 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.028485 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.029255 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.029688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.157432 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:25.165162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d416abf1-6c87-41dd-aebf-8214293f5df1 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.148333 May 26 21:44:25.165734 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 701/1353] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:25 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:26.183085 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:26.183807 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:26.190520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:26.190974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.191735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:26.192197 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.325104 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:26.332597 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-3a0e2428-f6d5-45f5-9e26-c01065376db3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.154367 May 26 21:44:26.333157 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 653/1354] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:26 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:27.349529 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:27.350127 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:27.357758 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:27.358211 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:27.359002 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:27.359440 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:27.492052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:27.507445 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-da0df8f8-cb1d-42bb-869d-fdf0b94d478a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.161817 May 26 21:44:27.508068 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 702/1355] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:27 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:28.525455 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:28.526162 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:28.532820 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:28.533269 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:28.534037 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:28.534538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:28.667117 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:28.674549 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-cdffbbe5-2931-4a4e-b225-42b3850a9179 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.153718 May 26 21:44:28.675263 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 654/1356] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:28 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:29.691587 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:29.692252 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:29.700026 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:29.700484 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:29.701279 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:29.701725 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:29.842625 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:29.850188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-831d909f-867f-4236-a67b-95ce6a1f3e24 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.162484 May 26 21:44:29.850761 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 703/1357] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:29 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:30.867663 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:30.868452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:30.870877 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:30.876043 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:30.876485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:30.877258 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:30.877695 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:31.013223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:31.023193 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dc5afafb-e9fc-483f-849b-051af11dfddc tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.159425 May 26 21:44:31.023814 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 655/1358] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:30 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:32.040494 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:32.041112 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:32.042966 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:32.043640 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=6 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:32.049245 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.049718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.050517 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.050952 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.191465 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:32.203497 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-129ece05-5dd2-46c4-9d1c-e8c6fcc8265c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.167219 May 26 21:44:32.208093 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 704/1359] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:32 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:32.278999 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-5aa411fe-17d1-499c-9e9c-229d654fe136 req-bba6508c-d3f2-4ef7-b5f0-2e4719e71f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d246af8-6729-4eb7-8f7d-eec6ffc8b19b", "name": "network-vif-plugged", "status": "completed", "tag": "9251f567-e9e0-4ae4-b147-a2c109756c0c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:32.287904 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5aa411fe-17d1-499c-9e9c-229d654fe136 req-bba6508c-d3f2-4ef7-b5f0-2e4719e71f54 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.293023 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-5aa411fe-17d1-499c-9e9c-229d654fe136 req-bba6508c-d3f2-4ef7-b5f0-2e4719e71f54 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.300967 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-5aa411fe-17d1-499c-9e9c-229d654fe136 req-bba6508c-d3f2-4ef7-b5f0-2e4719e71f54 service nova] Creating event network-vif-plugged:9251f567-e9e0-4ae4-b147-a2c109756c0c for instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b on hv-cinder-82880 May 26 21:44:32.306724 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-5aa411fe-17d1-499c-9e9c-229d654fe136 req-bba6508c-d3f2-4ef7-b5f0-2e4719e71f54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102537 May 26 21:44:32.307840 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 656/1360] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:33.222231 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:33.222796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:33.230718 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:33.231171 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:33.231992 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:33.232438 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:33.372987 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:33.381340 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-5561df9c-2cc8-4702-89fe-91c76f146d06 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.162991 May 26 21:44:33.381924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 705/1361] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:33 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:34.399687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:34.400339 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:34.406811 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:34.407290 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:34.408095 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:34.408529 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:34.545002 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:34.552762 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-ac0956aa-8d5e-432a-9915-e5a26a1565b7 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1363 microversion: 2.1 time: 0.158046 May 26 21:44:34.553355 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 657/1362] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:34 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:35.572463 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:35.574175 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:35.584012 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:35.584464 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:35.585325 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:35.585760 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:35.722873 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:35.731317 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-e13f76fd-5c9d-4ecd-a6c1-9e2f820db222 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1549 microversion: 2.1 time: 0.164912 May 26 21:44:35.731946 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 706/1363] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:44:35 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:35.801672 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:35.802186 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:35.808698 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:35.809143 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:35.809911 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:35.810347 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:35.894461 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-5214ccf2-b6dd-47aa-a547-8c7096ece4da tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148215 May 26 21:44:35.895056 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 658/1364] 10.222.0.42 () {58 vars in 1274 bytes} [Thu May 26 21:44:35 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:37.194180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-ecf37fe3-3be7-4bda-9bed-bbcfe9d17bd8 req-d248629a-f7f8-49e7-9a59-89b868748c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d246af8-6729-4eb7-8f7d-eec6ffc8b19b", "tag": "9251f567-e9e0-4ae4-b147-a2c109756c0c"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:37.203146 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-ecf37fe3-3be7-4bda-9bed-bbcfe9d17bd8 req-d248629a-f7f8-49e7-9a59-89b868748c85 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:37.203587 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-ecf37fe3-3be7-4bda-9bed-bbcfe9d17bd8 req-d248629a-f7f8-49e7-9a59-89b868748c85 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:37.215520 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-ecf37fe3-3be7-4bda-9bed-bbcfe9d17bd8 req-d248629a-f7f8-49e7-9a59-89b868748c85 service nova] Creating event network-changed:9251f567-e9e0-4ae4-b147-a2c109756c0c for instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b on hv-cinder-82880 May 26 21:44:37.221379 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-ecf37fe3-3be7-4bda-9bed-bbcfe9d17bd8 req-d248629a-f7f8-49e7-9a59-89b868748c85 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094900 May 26 21:44:37.223236 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 707/1365] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:45:42.149059 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:42.149726 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:42.154552 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:42.155068 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:42.168915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:42.168915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:42.168915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:42.168915 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:42.188078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-57aa759b-1b69-4423-8ad9-7784e0878c74 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/ips" status: 200 len: 145 microversion: 2.1 time: 0.041181 May 26 21:45:42.188687 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 659/1366] 10.222.0.42 () {58 vars in 1247 bytes} [Thu May 26 21:45:42 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:45:43.819404 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:43.820375 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=78 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:43.824675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b89f41a6-49eb-4a69-baa6-8a6193989f0e"}} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:45:43.825827 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:43.832239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:43.832682 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:43.833491 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:43.833926 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:44.586243 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4b0957e2-aa97-4cf8-9ba9-8d69a97c7b4a tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768448 May 26 21:45:44.586810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 708/1367] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:45:43 2022] POST /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:45:52.082114 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:52.083073 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:52.090527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.090981 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.091770 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.092217 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.121729 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-607f2a46-8a35-4d06-89af-6db53e0068d6 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 May 26 21:45:52.122285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 660/1368] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:45:52 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:45:52.133166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:52.133787 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:52.140573 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.141028 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.141796 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.142239 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.171939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7d937117-6324-4813-a504-9d2573dbe427 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/b89f41a6-49eb-4a69-baa6-8a6193989f0e" status: 200 len: 194 microversion: 2.1 time: 0.043468 May 26 21:45:52.172535 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 709/1369] 10.222.0.42 () {58 vars in 1412 bytes} [Thu May 26 21:45:52 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/b89f41a6-49eb-4a69-baa6-8a6193989f0e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:45:53.914474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04bf0909-1b78-4872-a6e1-1a5f57dcc2b3"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:45:53.915661 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:53.923508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:53.924092 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:53.924846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:53.925277 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:54.569730 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-228cc36e-b188-4744-9985-b95bc04a75e9 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "POST /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659085 May 26 21:45:54.570274 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 661/1370] 10.222.0.42 () {60 vars in 1322 bytes} [Thu May 26 21:45:53 2022] POST /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:46:02.074266 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:02.075277 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:02.082403 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.082845 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.083600 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.084090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.113398 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4b2d1161-59dd-4d7c-b78d-1c417d8481a3 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043122 May 26 21:46:02.113945 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 710/1371] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:46:02 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:46:02.264039 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:02.264617 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:02.271815 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.272275 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.273074 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.273540 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.305519 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-b9c55d86-1bcf-4b27-85c6-c3992f374c8c tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/b89f41a6-49eb-4a69-baa6-8a6193989f0e" status: 200 len: 194 microversion: 2.1 time: 0.046404 May 26 21:46:02.306127 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 662/1372] 10.222.0.42 () {58 vars in 1412 bytes} [Thu May 26 21:46:02 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/b89f41a6-49eb-4a69-baa6-8a6193989f0e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:46:02.316261 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:02.316741 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:02.322931 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.323376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.324176 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.324609 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.410116 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lazy-loading 'services' on Instance uuid 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:46:02.635673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4d0f2490-3a67-49ce-a9b1-2f2191747f91 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/b89f41a6-49eb-4a69-baa6-8a6193989f0e" status: 202 len: 0 microversion: 2.1 time: 0.323709 May 26 21:46:02.636673 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 711/1373] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:46:02 2022] DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/b89f41a6-49eb-4a69-baa6-8a6193989f0e => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:46:04.813273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:04.813842 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:04.820607 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.821065 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.821844 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.822287 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.851270 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-2b22cdbd-384d-410e-83c9-dee6e97c1d6e tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/04bf0909-1b78-4872-a6e1-1a5f57dcc2b3" status: 200 len: 194 microversion: 2.1 time: 0.042613 May 26 21:46:04.851878 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 663/1374] 10.222.0.42 () {58 vars in 1412 bytes} [Thu May 26 21:46:04 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/04bf0909-1b78-4872-a6e1-1a5f57dcc2b3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:46:04.862632 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:04.863209 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:04.869863 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.870306 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.871065 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.871524 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.954663 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lazy-loading 'services' on Instance uuid 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:46:05.161302 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d2a62455-6daa-45f7-9c31-d81490c1cf36 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/04bf0909-1b78-4872-a6e1-1a5f57dcc2b3" status: 202 len: 0 microversion: 2.1 time: 0.303283 May 26 21:46:05.161907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 712/1375] 10.222.0.42 () {58 vars in 1415 bytes} [Thu May 26 21:46:04 2022] DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments/04bf0909-1b78-4872-a6e1-1a5f57dcc2b3 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:46:06.602432 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:06.603429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:06.610855 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.611308 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.612141 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.612581 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.646612 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-f5d7661a-62dd-4bae-aa4d-549aa1dac0eb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048170 May 26 21:46:06.647204 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 664/1376] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:46:06 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:46:06.774367 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:06.775333 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:06.782219 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.782676 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.783472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.783965 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.817570 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-69ed85a6-00c0-4b19-bf59-a920455eae18 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048196 May 26 21:46:06.818166 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 713/1377] 10.222.0.42 () {58 vars in 1301 bytes} [Thu May 26 21:46:06 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:46:06.883485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:06.884008 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:06.890327 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.891467 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.892273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.892710 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.919421 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:46:07.229878 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-09573370-0330-4fd1-82f4-4f41825b01c2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 204 len: 0 microversion: 2.1 time: 0.349998 May 26 21:46:07.230471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 665/1378] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:46:06 2022] DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:46:07.239371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:07.240020 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:07.246912 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.249675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.249675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.249675 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.386183 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:07.394084 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7b6b2f25-8fce-44b8-b967-074b7cfa2128 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1673 microversion: 2.1 time: 0.158764 May 26 21:46:07.394661 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 714/1379] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:07 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:08.411334 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:08.412076 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:08.419176 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:08.419625 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:08.420431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:08.420869 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:08.560623 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:08.569053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4a59cfca-da0b-428c-91e6-ab5e21eef843 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1673 microversion: 2.1 time: 0.162110 May 26 21:46:08.569639 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 666/1380] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:08 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:09.587378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:09.588200 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:09.596111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:09.597123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:09.597537 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:09.597986 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:09.736123 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:09.744590 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-db8766c1-903f-452a-bbee-8d813d29dd81 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1673 microversion: 2.1 time: 0.162201 May 26 21:46:09.745188 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 715/1381] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:09 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:10.283628 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-e879d9c6-694f-4662-9f32-64859b1efbf4 req-2eae57d3-031b-4110-ab97-2a366735cc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d246af8-6729-4eb7-8f7d-eec6ffc8b19b", "name": "network-vif-deleted", "tag": "9251f567-e9e0-4ae4-b147-a2c109756c0c"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:46:10.294234 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-e879d9c6-694f-4662-9f32-64859b1efbf4 req-2eae57d3-031b-4110-ab97-2a366735cc39 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:10.295017 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-e879d9c6-694f-4662-9f32-64859b1efbf4 req-2eae57d3-031b-4110-ab97-2a366735cc39 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:10.320892 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-e879d9c6-694f-4662-9f32-64859b1efbf4 req-2eae57d3-031b-4110-ab97-2a366735cc39 service nova] Creating event network-vif-deleted:9251f567-e9e0-4ae4-b147-a2c109756c0c for instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b on hv-cinder-82880 May 26 21:46:10.330940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-e879d9c6-694f-4662-9f32-64859b1efbf4 req-2eae57d3-031b-4110-ab97-2a366735cc39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106713 May 26 21:46:10.331873 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 667/1382] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:46:10.762716 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:10.763514 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:10.770740 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:10.771191 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:10.771996 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:10.772437 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:10.805426 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:10.805883 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:10.806339 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.objects.instance [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lazy-loading 'fault' on Instance uuid 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b {{(pid=118557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:46:10.851021 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e98f6491344656a94e199575494def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe887b2709bc446c8198c3d141c353af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:10.858493 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-3c14220f-4838-4522-b064-7838b089984d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 200 len: 1328 microversion: 2.1 time: 0.099647 May 26 21:46:10.859057 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 716/1383] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:10 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:11.877742 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:11.878431 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:11.885135 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:11.885581 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:11.886341 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:11.886776 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:11.900033 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] HTTP exception thrown: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Request method failure captured: May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b HTTP/1.1 May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_OXMEl1IB3vvxq17jtUr7iaafgUpCONrhjnOmAWxqarGfyppSCtYyDxmoaKCe7G03ortD5UT6ovN2QbSU_O8ZMT8bu_o1YH5IYPoP720FgpC7VwcPOUlgFVC7S95QLfwD2RyGQtaA3s-Te-zrbqUkv7d2zceGta0xPwhtZz2JZZhMc May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:46:11.901735 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe887b2709bc446c8198c3d141c353af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}] May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 63e98f6491344656a94e199575494def May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:11.903485 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '8d246af8-6729-4eb7-8f7d-eec6ffc8b19b'} May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:46:11.904542 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:11.906212 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:11.907953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Returning 404 to user: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:46:11.907953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-dbe20d88-0026-479c-9192-7e38c3031ebb tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 404 len: 111 microversion: 2.1 time: 0.030366 May 26 21:46:11.907953 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 668/1384] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:11 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:46:11.912921 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-0c5e1c2d-959e-4080-afbd-a16252c228f2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '.version_select at 0x7f7bca650160>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:11.994627 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-0c5e1c2d-959e-4080-afbd-a16252c228f2 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617083259" status: 202 len: 0 microversion: 2.1 time: 0.085620 May 26 21:46:11.995139 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 717/1385] 10.222.0.42 () {58 vars in 1220 bytes} [Thu May 26 21:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617083259 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:46:15.208872 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:15.209365 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:15.216035 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.216481 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.217237 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.217670 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.231570 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] HTTP exception thrown: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Request method failure captured: May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b HTTP/1.1 May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_OXMEl1IB3vvxq17jtUr7iaafgUpCONrhjnOmAWxqarGfyppSCtYyDxmoaKCe7G03ortD5UT6ovN2QbSU_O8ZMT8bu_o1YH5IYPoP720FgpC7VwcPOUlgFVC7S95QLfwD2RyGQtaA3s-Te-zrbqUkv7d2zceGta0xPwhtZz2JZZhMc May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:46:15.233131 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe887b2709bc446c8198c3d141c353af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}] May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 63e98f6491344656a94e199575494def May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.234846 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '8d246af8-6729-4eb7-8f7d-eec6ffc8b19b'} May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:46:15.235881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.237465 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:15.239078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Returning 404 to user: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:46:15.239078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-1054f9ce-defc-4839-85f8-fd54e361c267 tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 404 len: 111 microversion: 2.1 time: 0.029499 May 26 21:46:15.239078 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 669/1386] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:46:15 2022] DELETE /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:46:15.243929 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:15.244537 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:15.246483 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:15.252271 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.252713 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.253472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.253902 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.257957 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:15.267985 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] HTTP exception thrown: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Request method failure captured: May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b HTTP/1.1 May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_OXMEl1IB3vvxq17jtUr7iaafgUpCONrhjnOmAWxqarGfyppSCtYyDxmoaKCe7G03ortD5UT6ovN2QbSU_O8ZMT8bu_o1YH5IYPoP720FgpC7VwcPOUlgFVC7S95QLfwD2RyGQtaA3s-Te-zrbqUkv7d2zceGta0xPwhtZz2JZZhMc May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:46:15.269631 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe887b2709bc446c8198c3d141c353af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}] May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 63e98f6491344656a94e199575494def May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.271528 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '8d246af8-6729-4eb7-8f7d-eec6ffc8b19b'} May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:46:15.272579 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. May 26 21:46:15.274301 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:15.275772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Returning 404 to user: Instance 8d246af8-6729-4eb7-8f7d-eec6ffc8b19b could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:46:15.275772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cf1616c4-62d2-41ed-a0f2-61b3f906e79b tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b" status: 404 len: 111 microversion: 2.1 time: 0.031636 May 26 21:46:15.275772 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 718/1387] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:15 2022] GET /compute/v2.1/servers/8d246af8-6729-4eb7-8f7d-eec6ffc8b19b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:46:16.538429 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:16.538965 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:16.545430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:16.545876 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:16.546654 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:16.547084 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:16.560471 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.wsgi [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] HTTP exception thrown: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Request method failure captured: May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: request: DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 HTTP/1.1 May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept: application/json May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Accept-Encoding: identity May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Connection: close May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Length: 0 May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Content-Type: application/json May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Host: 10.222.0.42 May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Openstack-System-Scope: None May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: User-Agent: python-urllib3/1.26.9 May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Auth-Token: gAAAAABij_OXMEl1IB3vvxq17jtUr7iaafgUpCONrhjnOmAWxqarGfyppSCtYyDxmoaKCe7G03ortD5UT6ovN2QbSU_O8ZMT8bu_o1YH5IYPoP720FgpC7VwcPOUlgFVC7S95QLfwD2RyGQtaA3s-Te-zrbqUkv7d2zceGta0xPwhtZz2JZZhMc May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Id: None May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Domain-Name: None May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Identity-Status: Confirmed May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Is-Admin-Project: True May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Id: default May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Domain-Name: Default May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Project-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Role: member,reader May 26 21:46:16.561993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Roles: member,reader May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe887b2709bc446c8198c3d141c353af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}] May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Id: default May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Domain-Name: Default May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Id: 63e98f6491344656a94e199575494def May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: X-User-Name: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: method: > May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: exception: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.564168 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: action_args: {'id': '8693fdb4-b4bb-4887-9074-425572842c02'} May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:46:16.565295 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.566881 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: ERROR nova.api.openstack.wsgi May 26 21:46:16.568605 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Returning 404 to user: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. {{(pid=118558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:46:16.568605 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-fe077bd7-7d7f-4f4f-a0cb-355577882cba tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 404 len: 111 microversion: 2.1 time: 0.029062 May 26 21:46:16.568605 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 670/1388] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:46:16 2022] DELETE /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:46:16.572113 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:16.572726 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] [instance: 8693fdb4-b4bb-4887-9074-425572842c02] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:16.581156 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:16.581606 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:16.582371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:16.582810 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:16.596472 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] HTTP exception thrown: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Request method failure captured: May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 HTTP/1.1 May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_OXMEl1IB3vvxq17jtUr7iaafgUpCONrhjnOmAWxqarGfyppSCtYyDxmoaKCe7G03ortD5UT6ovN2QbSU_O8ZMT8bu_o1YH5IYPoP720FgpC7VwcPOUlgFVC7S95QLfwD2RyGQtaA3s-Te-zrbqUkv7d2zceGta0xPwhtZz2JZZhMc May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:46:16.598004 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe887b2709bc446c8198c3d141c353af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe887b2709bc446c8198c3d141c353af"}]}] May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: fe887b2709bc446c8198c3d141c353af May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2035704259 May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 63e98f6491344656a94e199575494def May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-AttachVolumeTestJSON-2035704259-project May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.599715 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '8693fdb4-b4bb-4887-9074-425572842c02'} May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:46:16.601031 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. May 26 21:46:16.602602 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:46:16.604154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] Returning 404 to user: Instance 8693fdb4-b4bb-4887-9074-425572842c02 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:46:16.604154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-fe457db6-c6bc-4bff-8d2e-5092fe346e9d tempest-AttachVolumeTestJSON-2035704259 tempest-AttachVolumeTestJSON-2035704259-project] 10.222.0.42 "GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02" status: 404 len: 111 microversion: 2.1 time: 0.031051 May 26 21:46:16.604154 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 719/1389] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:46:16 2022] GET /compute/v2.1/servers/8693fdb4-b4bb-4887-9074-425572842c02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:46:59.846104 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:46:59.846907 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:47:06.045882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:47:06.046452 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:47:22.017188 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:47:22.017834 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:47:32.799584 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:32.800370 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:32.806066 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-162788151", "imageRef": "dbd1acc5-6e68-49fe-b869-a32ec75f5212", "flavorRef": "452"}} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:47:33.052626 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.network.neutron [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] validate_networks() for None {{(pid=118558) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:47:33.328761 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Flavor limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:47:33.329179 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Image limits 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:47:33.329652 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Flavor pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:47:33.330052 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Image pref 0:0:0 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:47:33.330456 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.virt.hardware [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:47:33.339377 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:33.339836 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:33.340623 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:33.341053 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:33.357390 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Getting quotas for project df9771acff0a4257add6cd30be632e7d. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:47:33.361283 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.quota [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Getting quotas for user 451a2a9257854273845a45f544cd2b39 and project df9771acff0a4257add6cd30be632e7d. Resources: {'cores', 'ram', 'instances'} {{(pid=118558) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:47:33.372992 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Going to run 1 instances... {{(pid=118558) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:47:33.375238 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dbd1acc5-6e68-49fe-b869-a32ec75f5212',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:47:33.543203 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-545d9c45-39df-4d14-a974-816c38854b17 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745068 May 26 21:47:33.543771 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 671/1390] 10.222.0.42 () {60 vars in 1146 bytes} [Thu May 26 21:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:47:33.556620 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-f211c9f9-50b7-447b-95f1-cbbb2e769609 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:33.557220 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-f211c9f9-50b7-447b-95f1-cbbb2e769609 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:33.734647 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-f211c9f9-50b7-447b-95f1-cbbb2e769609 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:33.746937 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-f211c9f9-50b7-447b-95f1-cbbb2e769609 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1214 microversion: 2.1 time: 0.196725 May 26 21:47:33.748022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 720/1391] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:33 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:34.773462 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:34.774040 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:34.782183 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:34.782637 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:34.783408 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:34.783895 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:34.846005 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:34.853759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4e2d0179-1f8b-4ec6-8ee8-ec29d9316ac2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1218 microversion: 2.1 time: 0.084858 May 26 21:47:34.854332 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 672/1392] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:34 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:35.871052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:35.874469 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:35.879771 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:35.880208 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:35.881102 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:35.881577 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:35.943550 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:35.951180 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-7171030b-5624-4ab7-a1b6-53f6cf6a5683 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1272 microversion: 2.1 time: 0.083997 May 26 21:47:35.952597 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 721/1393] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:35 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:36.968369 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:36.968982 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:36.976075 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:36.976527 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:36.977301 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:36.977749 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:37.198223 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:37.206685 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-4d7a9b10-d205-46ba-b6ef-389b102d5141 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.242109 May 26 21:47:37.207628 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 673/1394] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:36 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:37.417540 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-f2c95c74-7670-48df-b3e2-1de6e021493a req-1703c83c-4c28-44d0-88e5-53b0ffe7352a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264bbd99-505d-45fb-beb5-465545db2fc5", "tag": "91d12a2b-7b75-4333-99ef-efc987453d6b"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:47:37.426821 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-f2c95c74-7670-48df-b3e2-1de6e021493a req-1703c83c-4c28-44d0-88e5-53b0ffe7352a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:37.427567 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-f2c95c74-7670-48df-b3e2-1de6e021493a req-1703c83c-4c28-44d0-88e5-53b0ffe7352a service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:37.440705 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-f2c95c74-7670-48df-b3e2-1de6e021493a req-1703c83c-4c28-44d0-88e5-53b0ffe7352a service nova] Creating event network-changed:91d12a2b-7b75-4333-99ef-efc987453d6b for instance 264bbd99-505d-45fb-beb5-465545db2fc5 on hv-cinder-82880 May 26 21:47:37.446467 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-f2c95c74-7670-48df-b3e2-1de6e021493a req-1703c83c-4c28-44d0-88e5-53b0ffe7352a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034518 May 26 21:47:37.447081 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 722/1395] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:47:38.225633 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:38.226243 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:38.232887 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:38.233333 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:38.234106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:38.234538 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:38.387134 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:38.394993 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-e12a8a8b-090c-4ba4-88cc-e74a71519035 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.173573 May 26 21:47:38.395555 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 674/1396] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:38 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:39.413784 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:39.414481 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:39.421402 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:39.421852 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:39.422635 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:39.423069 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:39.556604 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:39.564353 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-94e4592e-0d96-4ddd-817b-aca2716e0d0f tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.155734 May 26 21:47:39.568051 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 723/1397] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:39 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:40.581785 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:40.582351 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:40.589116 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:40.589575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:40.590353 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:40.590795 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:40.719273 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:40.727340 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-49dc2137-3156-43cc-9967-cb7b36614f0d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.149563 May 26 21:47:40.727990 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 675/1398] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:40 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:41.744070 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:41.744688 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:41.751215 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:41.751672 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:41.752509 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:41.752947 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:41.881038 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:41.888462 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-d905bcd7-103a-4853-b1d0-dc7b0fe1c5aa tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.148316 May 26 21:47:41.889022 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 724/1399] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:41 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:42.905430 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:42.906061 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:42.913775 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:42.914239 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:42.915030 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:42.915479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:43.054938 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:43.062489 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-de7e1429-529b-477a-8357-d371df4b3c3a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.160954 May 26 21:47:43.063187 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 676/1400] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:42 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:44.080450 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:44.081071 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:44.083649 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG dbcounter [-] [118557] Writing DB stats nova_cell0:SELECT=2 {{(pid=118557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:44.088924 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:44.089376 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:44.090158 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:44.090595 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:44.226963 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:44.234413 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-4baa6802-27f4-4ff8-8413-efb513f584d3 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.157869 May 26 21:47:44.234968 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 725/1401] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:44 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:45.130416 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [req-b5f4bf7d-1d53-49f8-a7d0-bf640d3506d7 req-c5a13460-b98b-445d-a3cb-4ef8d45363ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264bbd99-505d-45fb-beb5-465545db2fc5", "name": "network-vif-plugged", "status": "completed", "tag": "91d12a2b-7b75-4333-99ef-efc987453d6b"}]} {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:47:45.133940 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=2 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:45.134660 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG dbcounter [-] [118558] Writing DB stats nova_cell0:SELECT=6 {{(pid=118558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:45.140460 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-b5f4bf7d-1d53-49f8-a7d0-bf640d3506d7 req-c5a13460-b98b-445d-a3cb-4ef8d45363ae service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.143479 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [req-b5f4bf7d-1d53-49f8-a7d0-bf640d3506d7 req-c5a13460-b98b-445d-a3cb-4ef8d45363ae service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.152106 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.compute.server_external_events [req-b5f4bf7d-1d53-49f8-a7d0-bf640d3506d7 req-c5a13460-b98b-445d-a3cb-4ef8d45363ae service nova] Creating event network-vif-plugged:91d12a2b-7b75-4333-99ef-efc987453d6b for instance 264bbd99-505d-45fb-beb5-465545db2fc5 on hv-cinder-82880 May 26 21:47:45.157300 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [req-b5f4bf7d-1d53-49f8-a7d0-bf640d3506d7 req-c5a13460-b98b-445d-a3cb-4ef8d45363ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 May 26 21:47:45.157934 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 677/1402] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:47:45.252279 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:45.252889 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:45.259723 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.260196 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.260979 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.261420 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.420801 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:45.435111 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-84d88959-69a1-471e-9397-0cb3c4da6ab6 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.186513 May 26 21:47:45.436230 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 726/1403] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:45 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:46.462022 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:46.462774 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:46.470304 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:46.470764 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:46.471537 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:46.472011 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:46.606508 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:46.614474 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-a57d1880-b2d0-4db8-886d-dc9db884e227 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1314 microversion: 2.1 time: 0.157849 May 26 21:47:46.615067 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 678/1404] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:46 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:47.631569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:47.632242 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:47.638865 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.639320 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.640130 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.640569 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.774373 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:47.782011 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-df6edbc8-8509-4d35-a933-f99ac68a3ee2 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1463 microversion: 2.1 time: 0.154921 May 26 21:47:47.782588 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 727/1405] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:47 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:47.823520 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:47.824091 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:47.830575 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.831024 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.831825 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.832262 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.857806 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Going to try to terminate instance {{(pid=118558) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:47:48.119182 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-73fe1238-a8c7-4df5-9e6b-f746666a0474 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "DELETE /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 204 len: 0 microversion: 2.1 time: 0.299180 May 26 21:47:48.120041 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 679/1406] 10.222.0.42 () {58 vars in 1238 bytes} [Thu May 26 21:47:47 2022] DELETE /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:47:48.128479 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:48.129120 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:48.136062 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:48.140601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:48.140601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:48.140601 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:48.267846 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.policy [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118557) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:48.275939 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-cb1214ec-b19b-4128-966b-8422f49952d7 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1469 microversion: 2.1 time: 0.151802 May 26 21:47:48.276560 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 728/1407] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:48 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:49.294242 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:49.294961 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:49.301494 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:49.301949 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:49.303396 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:49.303882 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:49.445298 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:49.452991 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-bdc050c0-65d5-4781-8939-8f228b27b74a tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1469 microversion: 2.1 time: 0.163065 May 26 21:47:49.453593 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 680/1408] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:49 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:50.087370 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [req-602ef0f4-83b3-4829-8509-9745c20547aa req-55c731be-029d-43b0-8f0e-b120cd896329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264bbd99-505d-45fb-beb5-465545db2fc5", "name": "network-vif-deleted", "tag": "91d12a2b-7b75-4333-99ef-efc987453d6b"}]} {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:47:50.096221 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-602ef0f4-83b3-4829-8509-9745c20547aa req-55c731be-029d-43b0-8f0e-b120cd896329 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.096816 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [req-602ef0f4-83b3-4829-8509-9745c20547aa req-55c731be-029d-43b0-8f0e-b120cd896329 service nova] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.109417 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.compute.server_external_events [req-602ef0f4-83b3-4829-8509-9745c20547aa req-55c731be-029d-43b0-8f0e-b120cd896329 service nova] Creating event network-vif-deleted:91d12a2b-7b75-4333-99ef-efc987453d6b for instance 264bbd99-505d-45fb-beb5-465545db2fc5 on hv-cinder-82880 May 26 21:47:50.114587 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [req-602ef0f4-83b3-4829-8509-9745c20547aa req-55c731be-029d-43b0-8f0e-b120cd896329 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031097 May 26 21:47:50.115294 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 729/1409] 10.222.0.42 () {64 vars in 1317 bytes} [Thu May 26 21:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:47:50.470267 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.api.openstack.wsgi [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:50.470969 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.compute.api [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118558) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:50.478531 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.478974 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.479766 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.480224 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.513384 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.513832 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG oslo_concurrency.lockutils [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.514285 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.objects.instance [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lazy-loading 'fault' on Instance uuid 264bbd99-505d-45fb-beb5-465545db2fc5 {{(pid=118558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:47:50.560293 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: DEBUG nova.policy [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '451a2a9257854273845a45f544cd2b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9771acff0a4257add6cd30be632e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118558) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:50.567894 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO nova.api.openstack.requestlog [None req-30a32813-420e-4a39-91db-3f0beede5e3d tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 200 len: 1304 microversion: 2.1 time: 0.101634 May 26 21:47:50.568564 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: [pid: 118558|app: 0|req: 681/1410] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:50 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:51.589731 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Calling method '>' {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:51.590476 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.compute.api [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] [instance: 264bbd99-505d-45fb-beb5-465545db2fc5] Fetching instance by UUID {{(pid=118557) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:51.596923 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:51.597375 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:51.598162 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:51.598581 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG oslo_concurrency.lockutils [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Lock "32e2bb36-b7b6-4358-a218-787992281ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:51.615052 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.wsgi [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] HTTP exception thrown: Instance 264bbd99-505d-45fb-beb5-465545db2fc5 could not be found. May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Request method failure captured: May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: request: GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 HTTP/1.1 May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept: application/json May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Accept-Encoding: identity May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Connection: close May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Length: 0 May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Content-Type: application/json May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Host: 10.222.0.42 May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Openstack-System-Scope: None May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: User-Agent: python-urllib3/1.26.9 May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Auth-Token: gAAAAABij_VyM0l2BeLlKnhgSgKWKe58icsxR363s7RWL-pk0QN1319eDOxJFngbbiYYRql1mexCWGxRpbK6lXWVgJ_KUN08HfvjUVaptrn4F0aZEtbzDd35BKb28rHz5CzW4e9EQwl_yQ520KlmHQxIejtXBzzAA2qMztYwCkMLcJM4QXrUoRk May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Id: None May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Domain-Name: None May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Identity-Status: Confirmed May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Is-Admin-Project: True May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Id: default May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Domain-Name: Default May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Id: df9771acff0a4257add6cd30be632e7d May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Project-Name: tempest-VolumesNegativeTest-870052998 May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Role: member,reader May 26 21:47:51.617378 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Roles: member,reader May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df9771acff0a4257add6cd30be632e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df9771acff0a4257add6cd30be632e7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df9771acff0a4257add6cd30be632e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df9771acff0a4257add6cd30be632e7d"}]}] May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant: tempest-VolumesNegativeTest-870052998 May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Id: df9771acff0a4257add6cd30be632e7d May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-Tenant-Name: tempest-VolumesNegativeTest-870052998 May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User: tempest-VolumesNegativeTest-870052998-project May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Id: default May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Domain-Name: Default May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Id: 451a2a9257854273845a45f544cd2b39 May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: X-User-Name: tempest-VolumesNegativeTest-870052998-project May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: method: > May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: exception: Instance 264bbd99-505d-45fb-beb5-465545db2fc5 could not be found. May 26 21:47:51.619371 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: action_args: {'id': '264bbd99-505d-45fb-beb5-465545db2fc5'} May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: {{(pid=118557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264bbd99-505d-45fb-beb5-465545db2fc5 could not be found. May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:47:51.620611 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264bbd99-505d-45fb-beb5-465545db2fc5 could not be found. May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264bbd99-505d-45fb-beb5-465545db2fc5 could not be found. May 26 21:47:51.622323 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: ERROR nova.api.openstack.wsgi May 26 21:47:51.623944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: DEBUG nova.api.openstack.wsgi [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] Returning 404 to user: Instance 264bbd99-505d-45fb-beb5-465545db2fc5 could not be found. {{(pid=118557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:47:51.623944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO nova.api.openstack.requestlog [None req-34a52699-27f3-4f04-971a-284671843059 tempest-VolumesNegativeTest-870052998 tempest-VolumesNegativeTest-870052998-project] 10.222.0.42 "GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5" status: 404 len: 111 microversion: 2.1 time: 0.033806 May 26 21:47:51.623944 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: [pid: 118557|app: 0|req: 730/1411] 10.222.0.42 () {58 vars in 1235 bytes} [Thu May 26 21:47:51 2022] GET /compute/v2.1/servers/264bbd99-505d-45fb-beb5-465545db2fc5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:48:55.413668 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:48:55.414938 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:50:19.855861 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:50:19.857374 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:50:26.054297 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:50:26.054869 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:50:41.554090 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:50:41.554925 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:50:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:50:42.025072 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:50:42.025759 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:50:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:50:49.136209 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:50:49.136960 dv-cinder-828805-3-iscsi devstack@n-api.service[118558]: Thu May 26 21:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:52:15.421894 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:52:15.423153 dv-cinder-828805-3-iscsi devstack@n-api.service[118557]: Thu May 26 21:52:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!